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EXECUTIVE  SUMMARY 


OBJECTIVE 

This  phase  of  the  USCG  Training  and  Licensing  project 
established  a  method  for  determining  performance  stand 
ards  to  be  used  to  assess  the  effectiveness  of  training 
shiphandling  on  a  simulatoi.  The  Computer  Aided  Opera¬ 
tions  Research  Facility  (CAORF)  located  in  Kings  Point 
New  York  was  used  in  this  research  program. 

METHOD  OF  APPROACH 

Five  scenarios  were  designed  to  measure  five  different 
aspects  of  shiphandling: 

•  Approaching  a  harbor 

•  Responding  to  a  rudder  failure  in  confined  waters 

•  Negotiating  a  51  turn  with  passing  ship  effects 

•  Negotiating  a  129  turn  around  a  shoal  with  oncoming 
traffic 

•  Responding  to  a  propulsion  failuie  m  the  vicinity  of  a 
bridge  and  shoal 

It  was  reasoned  that  the  level  of  performance  which  a 
trainee  achieves  in  each  of  these  test  scenarios  should 
improve  after  a  simulator  training  program.  However,  it 

was  critical  to  demonstrate  that  these  test  scenarios  were 
sensitive  to  various  levels  of  performance  To  demonstrate 
this  sensitivity  the  following  research  was  conducted. 

PROCEDURE 

Fourteen  active  first  class  pilots  with  80,000  DWT  tanker 
experience  considered  expert  shiphandlers  by  their  peers, 
were  asked  to  con  an  80,000  DWT  tanker  thiouqh  the  five 
test  scenarios. 


Fourteen  chief  mates  upgiadmg  to  mastei  were  then  asked 
to  perform  the  same  tasks.  These  chief  mates,  while 
seasoned  mariners,  weie  minimally  experienced  in  actual 
shiphandling.  The  two  groups  were  then  compared  on  their 
shiphandling  performance  through  these  five  test  scenarios, 

PERFORMANCE  MEASURES 

The  performance  measuies  for  each  of  the  scenarios  aie 
listed  below. 

Scenario  A.  Shiphandling  during  Harbor  Approach.  Per¬ 
formance  measures'. 

•  Recognition  that  a  buoy  was  off-station 

•  Mean  deviation  in  feet  off  centerline 

•  Maximum  deviation  in  feet  off  centerline 

•  Mean  deviaton  in  feet  off  aveiage  tiackline' 

•  Maximum  deviation  in  feet  off  average  tiackline 

Scenario  1,  Shiphandling  in  response  to  a  rudder  failure  in 
confined  waters.  Performance  measuies 

•  Whether  ownshrp  collided  with  any  of  three  anchoied 
ships 

•  Whether  ownship  collided  with  the  pieis 

•  Closest  point  of  approach  (CPAI  >n  feet  to  two  of  the 
anchored  ships 

•  The  amount  of  time  nr  seconds  it  took  to  induce  own 
ship  s  speed  to  less  than  2  knots 

•  The  amount  of  time  in  seconds  it  took  to  reduce  own 
step's  late  of  turn  to  less  than  or  equal  to  0.1  degree 
per  second. 


‘Average  trackline  refers  to  the  tiackline  which  hest  fits  the  route  taken  by  the  entire  group  of  subjects 


v 


Scenario  2,  Negotiating  a  51  turn  with  passing  ship  effects. 

Performance  measures: 


•  Closest  point  of  approach  (CPA)  in  feet  to  an  outbound 
container  ship 

•  Aver  age  swept  path  in  feet 

•  Maximum  swept  path  in  feet 

•  Ratio  of  average  swept  path  to  channel  width 

•  Ratio  of  maximum  swept  path  to  channel  width 


performance,  the  proportions  of  experts  and  novices  who 
scored  above  the  cutoff  value  would  have  to  differ  signifi 
cantly.  This  was  done  using  a  V  statistic.  Results  are 
summarised  below. 

RESULTS 

Actual  cutoff  scoies  and  the  proportions  of  sublets  who 
achieved  these  scores  are  reported  in  the  appendix  of  this 
report.  Below  is  a  summary  of  those  performance  measures 
which  adequately  discriminated  between  pilots  (expeits  in 
shiphandling)  and  chief  mates  upgrading  to  masters  (novices 
in  shiphandling). 


•  Whether  ownship  giounded  on  the  channel  bottom 

Scenario  3,  Negotiating  a  129  turn  around  a  shoal  with 
oncoming  traffic.  Performance  measures: 


Scenario  A,  Harbor  Approach.  Performance  measures 
useful  as  training  criteria: 

•  Recognition  of  buoy  off  station 


•  Average  swept  path  in  feet 


•  Mean  deviation  off  centerline 


Maximum  swept  path  in  feet 


•  Maximum  deviation  off  centerline 


Ratio  of  average  swept  path  to  channel  width 


•  Mean  deviation  off  aveiage  trackline 


•  Ratio  of  maximum  swept  path  to  channel  width 


•  Maximum  deviation  of  aveiage  trackline 


•  Whether  ownship  grounded  on  the  channel  bottom 


Performance  measures  not  useful  as  tiaining  criteria: 


•  CPA  m  feet  to  a  tug  tow 


•  None 


Scenario  4,  Shiphandling  in  response  to  a  propulsion  failure 
in  the  vicinity  of  a  bridge  and  shoal.  Performance  measures 


Scenario  1,  Rudder  Failure.  Performance  measuies  useful 
as  training  criteria: 


Grounding  on  a  shoal 


•  Time  to  reduce  speed  (including  collisions) 


Collision  with  a  railroad  bridge 


Performance  measuies  not  useful  as  training  criteria 


EVALUATION  OF  PERFORMANCE  MEASURES 


•  CPA  to  Ship  3  (including  collisions) 


A  90%  confidence  interval  about  the  pilots'  average  score 
was  computed  foi  each  performance  measure  for  each 
scenario.  The  lower  limit  of  this  confidence  interval 
reflected  the  lowest  value  that  the  pilots'  mean  score  could 
be,  given  a  90%  level  of  confidence.  Ths  lower  limit  was 
then  used  as  a  cutoff  score  for  adequate  performance. 

The  data  were  then  reanalyzed  to  deteimme  the  propoi 
tions  of  pilots  (experts)  and  chief  mates  (novices)  who 
scored  better  than  this  cutoff  value  For  the  test  scenarios 
to  be  deemed  sensitive  to  various  levels  of  shiphandtmg 


CPA  to  Ship  3  (excluding  collisions) 


•  CPA  to  Ship  4 


•  Time  to  reduce  speed  (excluding  collisions) 


Time  to  induce  rate  of  turn  (excluding  collisions) 


•  Collision  with  piers 


•  Collisions  with  either  ship  or  piei 


Scenario  2,  51  Turn.  Performance  measures  useful  as 
training  criteria: 

•  None 

Performance  measures  not  useful  as  training  criteria: 

•  CPA  to  outbound  containership 

•  Maximum  swept  path 

•  Average  swept  path 

•  Maximum  ratio  swept  path 

•  Average  ratio  swept  path 

Scenario  3,  129  Turn.  Performance  measures  useful  as 
training  criteria: 

•  Maximum  swept  path 

•  Maximum  ratio  swept  path 

Performance  measures  not  useful  as  training  criteria: 

•  Maximum  swept  path 

•  Maximum  ratio  swept  path 


Performance  measures  not  useful  as  training  criteria: 

•  Average  swept  path 

•  Average  ratio  swept  path 

Scenario  4,  Propulsion  Failure.  Performance  measures 
useful  as  training  criteria: 

•  Safe  completion  of  transit 

Performance  measures  not  useful  as  training  criteria: 

•  Groundings  on  shoai 

•  Collisions  with  bridge 

SUMMARY 

The  phase  3  research  was  designed  to  establish  performance 
standards  for  simulator  training  of  chief  mates  upgrading 
to  masters.  Five  different  scenarios  incorporating  numerous 
training  objectives  were  presented  to  pilots  (expert  ship- 
handlers)  and  chief  mates  (potential  trainees)  and  then 
shiphandling  abilities  were  measured.  Four  of  the  five 
scenarios  yielded  statistically  valid  performance  standards. 
The  methodology  and  results  on  the  research  are  reported 
in  detail  in  the  text  and  appendices. 
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CHAPTER  1 


INTRODUCTION 


In  response  to  the  IMCO  convention  resolution  on  Stand 
ards  of  Training  and  Watchkeeping,  all  member  maritime 
nations  have  agreed  to  establish  a  standard  for  graduates 
of  maritime  academies  to  have  a  minimum  of  one  year  of 
at-sea  duty  prior  to  licensing.  Due  to  the  cost  associated 
with  the  maintenance  and  operation  of  vessels  at  sea, 
simulation  has  come  to  offer  a  viable  and  more  cost- 
effective  alternative  to  extending  the  current  at-sea  training 
periods.  Furthermore,  current  U.S.  legislation  has  called 
for  the  need  to  determine  the  effectiveness  of  simulation  in 
meeting  the  requirements  of  the  Port  and  Tanker  Safety 
Act  of  1978.  In  the  interest  of  achieving  these  objectives, 
the  multiphase  Training  and  Licensing  project  has  been 
jointly  sponsored  by  the  U.S.  Coast  Guard  and  the 
Maritime  Administration,  and  is  currently  ongoing  at 
CAORF.  The  goals  of  this  project  have  been  to  develop 
criteria  for  accrediting  simulator-based  training  programs 
in  order  to  meet  IMCO  requirements,  improve  the  safety 
of  vessels  operating  in  U.S.  waters,  and  to  protect  the 
operator  from  suffering  losses  due  to  participation  in 
ineffectual  simulator-based  training  programs. 


The  development  of  these  ciiteria  can  be  appioached  in 
several  fashions.  One  approach  would  impose  standards  on 
the  design  of  the  facility  itself,  as  well  as  its  training 
program  and  instructional  personnel.  A  second  approach 
would  require  graduates  of  the  facility's  training  piogiam 
to  meet  minimum  performance  ciiteria.  A  third  approach 
utilizes  a  combination  of  both  simulator  design  and  per¬ 
formance  standards. 

Phases  1  and  2  of  the  Training  and  Licensing  project 
focused  on  generating  data  to  be  used  m  the  evaluation  of 
simulator  design  characteristics.  Phase  3  of  the  project 
focused  on  refining  a  method  for  establishing  performance 
standards  for  those  trained  on  shiphandling  simulators. 

This  report  addresses  the  criteria  for  simulator  based  nam¬ 
ing  systems  at  the  master  chief  mate  level.  It  desctibes  the 
methods  used  and  results  obtained  in  establishing  perform 
ance  standards  for  licensed  individuals  who  have  partaken 
in  simulator-based  shiphandling  training  programs. 


CHAPTER  2 


ESTABLISHMENT  OF  PERFORMANCE  CRITERIA  FOR  SIMULATOR  TRAINING 


In  investigating  the  use  of  performance  testing  as  part  of 
the  mechanism  foi  acciediting  a  master  level  simulator- 
based  training  piogiam,  it  is  apparent  that  such  testing 
would  ideally  take  place  in  the  at-sea  enviionment.  How 
evei,  staggering  logistics  plus  a  large  element  of  risk  made 
it  desirable  to  employ  a  high  fidelity  simulator,  such  as 
CAORF,  as  a  suriogate  for  the  at-sea  environment. 

The  rationale  for  using  a  high  fidelity  simulatoi  m  place  of 
the  at-sea  environment  is  based  on  a  "backward  transfer 
of  training"  model.  In  this  model,  an  operator  who  is 
proficient  with  respect  to  the  desired  specific  functional 
objectives  (SFOs)  in  the  actual  operational  vehicle  is 
transferred  to  the  simulator,  where  he  is  required  to  per¬ 
form  tasks  corresponding  to  the  SFOs.  If  he  can  success¬ 
fully  perform  such  tasks  with  a  high  level  of  proficiency 
without  practice  on  the  simulator,  then  backwards  transfer 
of  training  has  been  demonstrated.  If  trainees  who  have 
completed  a  simulator  training  program  can  then  attain 
the  proficiency  levels  on  the  simulator  as  established  by 
the  expert  operators,  they  should  exhibit  a  positive  transfer 
of  training  when  placed  in  the  real  world  environment. 
It  should  be  noted  that  this  backward  transfei  of  training 
model  has  been  employed  at  COARF  in  the  original 
CAORF  validation  (Hammell,  1977)  and  the  evaluation  of 
the  Valdez  Operational  Exercises  (Williams,  1978). 

In  designing  the  Phase  3  experiment,  the  first  step  was  to 
select  a  standard  of  expertise  in  shiphandling  which  master 
level  trainees  could  strive  to  attain.  After  considerable  re¬ 
search  and  discussion,  "minimally  acceptable  shiphandling” 
was  designated  as  the  proficiency  with  which  pilots  per¬ 
formed  when  removed  from  their  areas  of  local  knowledge. 
It  was  reasoned  that  a  skilled  pilot  possesses  two  distinct 
sets  of  skills:  one  is  his  superior  law  shiphandling  ability, 
gained  generally  through  frequent  practice;  and  the  second 
is  his  local  knowledge,  which  to  a  great  extent  streamlines 
his  shiphandling  practices  through  foresight  and  past 
experience.  Operating  without  local  knowledge,  pilot 
proficiency  on  a  test  scenario  should  then  provide  an 
indication  of  the  performance  of  a  "better  than  average” 
shiphandler.  the  level  desired  for  mastei  candidates. 


To  ensure  that  the  scenano  used  in  Phase  3  piovided  high 
levels  of  discrimination  between  entry  level  (chief  mate 
master)  and  expert  (pilot)  performance,  exeicises  in  ship 
handling  were  administered  to  28  subjects:  14  weie  chief 
mates  upgrading  to  master,  and  14  were  pilots  fiom  aiound 
the  country  who  were  considered  by  theii  peers  to  be  the 
best  The  performance  of  both  groups  was  then  evaluated 
using  the  method  described  in  Section  2.4. 

A  description  of  the  perfoimance  test  scenano  along  with 
associated  results  and  conclusions  from  this  experiment 
appear  in  the  following  sections. 

2.1  THE  PERFORMANCE  TEST  SCENARIO 

The  actual  test  scenario  is  comprised  of  five  distinct  legs, 
each  designed  to  examine  a  particulai  aspect  of  ship¬ 
handling  proficiency.  The  following  paragraphs  contain 
a  brief  description  of  the  content  and  configuration  of  the 
various  legs,  as  well  as  their  objectives. 

LEG  A  —  Training  Objective.  Shiphandling  in  Harboi 
Approach  -  This  segment  was  designed  to  replicate  a 
typical  "harbor  approach”  exercise.  (See  Figuie  2-1.1.) 
Starting  in  open  sea  at  a  distance  of  appi oximatoly  8  miles 
from  the  pilot  station,  the  subject  was  required  to  navigate 
and  handle  the  vessel  in  a  traffic  separation  lane  which 
represented  the  approach  to  Port  XYZ.  Tins  scenario  was 
run  for  approximately  20  minutes  and  entailed  the  execu¬ 
tion  of  the  turn  in  the  tiaffic  lane,  an  endeavoi  which 
became  complicated  by  the  presence  of  tiaffic,  navigational 
aids  off  station,  etc.  The  sub|ect  had  two  excellent  shoie 
beacons  for  visual  beatings,  simulated  tadat,  fathometei , 
and  Loian  C  systems  available  foi  navigation.  Also  available 
was  a  new,  simulated  Automation  Direction  Finder  display, 
providing  digital  readouts  on  two  local  ladiobeacons. 
Necessary  publications  such  as  tide  tables,  weathei  lepoits, 
notices  to  manners,  etc.  weie  also  available  foi  peiusal. 
The  scenano  had  been  designed  so  that  visual  and  ladai 
scenes  became  intentionally  misleading  with  an  aid  moved 
from  its  chaiteri  position.  The  adherence  to  the  desired 


3 


Figure  2-1. 1.  Test  Scenario  Leg  A 


track  was  only  possible  through  the  careful  cross  checking 
of  navigational  information  from  several  of  the  Inputs 
available. 

LEG  1  -  Training  Objective:  Shiphandling  In  Response  to 
Rudder  Failure  in  Confined  Waters  -  Designed  to  examine 
the  area  of  emergency  shiphandling  under  rudder  failure 
conditions,  this  leg  commenced  in  upper  Wyassup  Bay, 


approximately  1  mile  south  southeast  of  the  "KV"  buoy  at 
the  Gibson's  Channel  entrance,  and  lan  foi  approximately 
15  minutes.  (See  Figure  2  1.2.)  At  this  point,  a  vessel 
speed  of  8  knots  was  most  normal  and  the  ship  had  not  yet 
picked  up  any  escort  tugs.  Confined  conditions  weie 
created  in  this  seemingly  open  water  area  by  placing  a  line 
of  these  anchoted  ships  along  the  easternmost  boundaiy  at 
Kingston  anchorage.  Approximately  60  seconds  into  the 
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Figure  2-1 .2.  Leg  1 


run,  the  subject  was  presented  with  a  rudder  failuie,  LEG  2  —  Training  Objective:  Navigating  a  51  Degree  Turn 

jammed  at  15  degrees  left,  in  the  presence  of  wind  and  with  Passing  Ship  Effects  This  segment  examined  the 
current.  Any  request  by  the  sub/ect  for  use  of  anchors  was  area  of  integrated  shiphandling,  that  is,  shiphandling  in 

countered  by  a  phone  call  from  the  bow  stating  that  the  the  presence  of  physical  forces  such  as  wind  and  current, 

windlass  brake  bands  had  jammed  (anchors  were  therefore  as  well  as  other  vessels  in  similar  environment  (See 

unusuable).  One  of  the  two  hypothetical  escort  tugs  re-  Figure  2-1. 3. 1  Subjects  began  at  6  knots,  misaligned  on 

sponded  to  any  distress  call  made,  but  did  not  arrive  before  the  Ferry  Point  Range.  Achievement  of  proper  alignment 

the  run  terminated.  The  tugs  were  shown  visually  as  and  negotiation  of  the  51  degiee  bend  was  tendered  some 

approaching  slowly  from  a  good  distance  ahead.  The  what  more  difficult  by  the  piesence  of  an  outbound  con 

subject  did  not  receive  rudder  control  back,  forcing  him  to  tamership,  which  met  ownship  near  the  apex  of  the  channel 

use  thruster  and  engine  power  to  maintain  a  safe  aspect  bend. 
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Figure  2-1.3.  Leg  2 


LEG  3  -  Training  Objective:  Negotiating  a  129  Degree 
Turn  Around  Shoal  with  Oncoming  Traffic  -  This  leg 
took  its  predecessor  one  step  further  in  that  the  bend  to  be 
negotiated  was  now  a  129  degiee  blind  turn.  (See  Figure 
2  1.4.)  Initial  speed  was  again  6  knots,  and  wind,  current, 
and  traffic  were  present  to  make  mote  difficult  the  execu 
tion  of  the  turn. 

LEG  4  —  Training  Objective:  Shiphandling  in  Response  to 
Propulsion  Failure  m  Vicinity  of  Bridge  and  Shoal  -  This 
segment  examined  emergency  shiphandling  as  a  result  of 
propulsion  plant  failure.  It  took  place  in  that  area  of 
Shellfish  Bay  which  lies  above  the  terminus  of  Leg  3, 
and  involves  a  drawbridge  transit  in  the  presence  of  a  power 
failure  (See  Figure  2  1.5.)  With  an  initial  speed  of  6  knots, 
the  scene  began  approximately  0.3  nautical  miles  below  the 
bridge  with  escort  tugs  on  either  bow  announcing  that 
their  lines  were  in  and  that  they  were  proceeding  ahead 
through  the  draw.  When  the  vessel  was  0.1  nautical  miles 
from  the  drawspan,  RPM  went  to  zero  and  the  chief  engi¬ 
neer  caller)  to  announce  that  the  plant  had  failed.  A  natural 


gas  pipeline  m  the  area  precluded  any  use  of  an  anchoi .  so 
the  subject  had  to  use  the  luddei  and  the  bow  thiuster 
judiciously  m  oidei  to  negotiate  the  budge  passage.  Thi ot 
tie  power  did  not  leturn,  and  the  scene  ended  upon  contact 
with,  or  safe  passage  thiough,  the  bridge.  It  should  be  noted 
that  although  the  budge  1 1 ansi t  was  difficult  without  pro¬ 
pulsion  machinery,  it  was  an  entirely  plausible  concept, 
as  well  as  a  totally  attainable  goal. 

2.2  SUBJECTS 

Masters 

The  masteis  who  participated  in  the  experiment  wete 
selected  to  represent  a  cross  section  of  those  entiy  level 
shiphandleis  who  would  benefit  most  fiom  this  type  of 
simulator- based  training.  The  basic  qualifications  of  these 
subjects  weie: 

1.  To  hold  a  cunent  masters  certificate  but  have  no 
previous  experience  as  master . 
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2  To  have  experience  aboard  tankers  in  the  80,000  DWT 
range 

To  obtain  a  representative  sample,  a  broad  range  of  ship¬ 
ping  companies  were  contacted  and  asked  to  supply  a  list 
of  people  who  fit  the  experimental  requirements  and  who 
would  be  available  for  the  experiment  (Maritime  Overseas, 
Chevron,  Aroo,  Exxon,  Gulf,  Keystone,  Zapata,  Trinidad, 
Ogden  Marine).  From  this  list  of  names,  individuals  were 
randomly  selected  and  contacted  until  the  full  comple¬ 
ment  of  14  subjects  was  reached. 

Before  the  experiment  began,  biographical  data  were 
collected  to  determine  the  background  and  actual  experi¬ 
ence  of  the  men  used  in  the  sample.  It  was  found  that  of 
the  14  subiects,  six  had  sailed  as  chief  mate  aboard  80,000 
DWT  tankers.  Two  of  these  individuals  acted  as  mooring 
masters  aboard  their  vessels,  but  had  no  experience  with 
shiphandling  in  channels.  The  remaining  eight  subjects 
had  chief  mate  experience  on  board  tankers  in  the 
60,000  to  70,000  DWT  range. 


The  masters  ranged  in  age  from  31  to  57  years  old  with  an 
average  age  of  40  years  old.  The  group  had  an  average  of 
15  years  of  experienced  as  licensed  deck  officers  with  a 
range  of  eight  to  thirty  years. 

Pilots 

The  qualifications  for  the  expert  shiphandler  category 
required  that  the  men  chosen: 

1.  Be  active  first  class  pilots  with  80,000  DWT  tanker 
experience. 

2.  Be  members  of  recognized  pilot  associations. 

3.  Be  selected  and  judged  by  peers  to  be  expert. 

4.  Have  no  pilotage  or  experience  in  New  York  Harbor. 

Pilot  associations  in  Boston,  Delaware,  Houston,  and  San 
Francisco  were  contacted  and  asked  to  provide  individuals 
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Figure  2-1.5.  Leg  4 


who  were  judged  to  represent  the  expert  shiphandlers  in 
these  associations.  In  this  sample,  there  were  four  Boston 
pilots,  five  Delaware  River  pilots,  four  Houston  ship 
channel  pilots,  and  one  San  Francisco  Bay  pilot.  The  men 
ranged  in  age  from  29  to  63  years  old  with  a  mean  age  of 
42  years  old.  Within  the  group  there  was  an  average  of 
18  years  of  shiphandling  experience  and  a  range  from  11 
to  35  years  of  shiphandling  experience. 

2.3  PERFORMANCE  MEASURES 

Measures  of  performance  were  selected  either  because  of 
their  direct  relevance  to  training  objectives  (e.g..  Did  the 
subject  notice  that  one  of  the  buoys  in  Leg  A  was  off 
station or  because  logical  inferences  about  shiphandling 
and  controllability  could  be  drawn  from  these  measures 
(e.g..  How  closely  did  the  subject  keep  on  track?).  The 
dependent  measures  used  in  this  study  were  also  selected 
for  their  sensitivity  to  manipulation  of  independent 
variables. 


The  performance  measures  used  for  each  training  objective 
are  described  below. 

Leg  A  —  Training  Objective:  Shiph,  'dling  in  Harbor 
Approach 

Recognition  of  Buoy  Off-Station 

It  was  hypothesized  that  pilots  would  attend  to  this  infoi- 
mation  more  than  masteis.  Given  that  a  subject  noticed 
the  buoy  off  station,  he  could  have  maneuvered  to  the  left 
of  the  buoy  m  oidot  to  stay  on  Hack.  Such  a  maneuvei  to 
port  would  have  minimized  off  tiack  deviation  Howevei , 
in  light  of  the  fact  that  a  traffic  ship  was  appioachmg  own 
ship  at  about  the  time  of  maneuvei.  the  subject  may  have 
noticed  the  buoy  off  station  but  maneuveied  to  the  nqht 
anyway  so  as  not  to  confuse  the  tiaffic  ship.  Thus,  the 
critical  measure  was  whether  the  subject  noticed  that  the 
buoy  was  off  station.  Maneuvering  either  to  the  left  oi  the 
right  of  the  buoy  was  not  necessarily  a  measure  of  good 
performance,  since  both  maneuvers  could  be  considered 
prudent. 
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Mean  Deviation  in  Feet  Off  Centerline 

This  measure  was  computed  by  summing  the  absolute 
values  of  deviations  off  centerline  and  dividing  by  the 
number  of  deviations. 

Maximum  Deviation  in  Feet  Off  Centerline 

This  was  the  absolute  value  of  the  maximum  deviation  off 
centerline. 

Mean  Deviation  in  Feet  Off  Average  Trackline 

The  average  trackline  for  each  group  of  sublets  was  com 
puted  and  mean  deviation  from  this  tiacklme  was  derived 
using  the  technique  employed  for  centerline. 

Maximum  Deviation  in  Feet  Off  Average  Trackline 

This  measure  was  the  absolute  value  of  the  sublet's  maxi¬ 
mum  deviation  off  his  group's  average  trackline. 

CPA  to  the  tiaffic  vessel  was  not  considered  a  performance 
measure  because  the  scenario's  objective  was  not  one  of 
collision  avoidance.  The  traffic  ship  in  Leg  A  was  placed 
there  to  add  realism  to  the  scenario  and  to  affect  the  sub 
ject's  maneuver  with  respect  to  the  buoy  off  its  station. 

Leg  1  —  Training  Ob|ective:  Shiphandling  in  Response  to 
Rudder  Failure  in  Confined  Waters 

Collision  with  Anchored  Ships 

In  this  leg  a  rudder  failure  occurred  when  ownship  was 
passing  by  three  anchored  ships.  A  direct  measure  of 
shiphandling  skill  In  this  situation  was  whethei  or  not 
ownship  collided  with  the  anchored  ships. 

CPA  in  Feet  to  Anchored  Ships  3  and  4 

Ship  3,  the  northernmost  anchored  ship,  was  the  ship  most 
susceptible  to  collision  as  a  result  of  the  mddei  failure.  If 
the  subject  did  not  accelerate  sufficiently  to  pass  Ship  3, 
a  collision  occurred.  Ship  4,  the  middle  anchoied  ship, 
was  most  vulnerable  to  collision  as  a  result  of  the  subject's 
failure  to  reduce  the  turn  rate  of  ownship.  The  closest 
point  of  approach  of  ownship  to  either  of  these  vessels  was 
measured  and  reported  in  feet. 

Whenever  the  CPA  to  Ship  3  or  4  was  zero  (indicating  a 
collision),  the  CPA  data  were  reported  both  including  and 
excluding  collisions. 


Time  (in  Seconds)  to  Reduce  Speed  Over  Ground  to  Less 
Than  2  Knots 

In  response  to  the  rudder  failure  in  Leg  1,  the  subiect  had 
to  reduce  the  speed  of  ownship  i  order  to  avoid  coll.jion 
with  either  the  anchored  ships  oi  piers.  The  time  it  took 
each  subject  aftei  the  rudder  failure  to  reduce  his  speeti 
over  ground  to  greater  than  2  knots  was  calculated  in 
seconds.  These  data  were  leported  foi  those  subjects  who 
had  collisions  as  well  as  those  subjects  who  nad  not.  In  the 
event  that  ownshm  never  reached  a  speed  greater  than 
2  knots,  the  minimum  speed  was  used. 

Time  (in  Seconds)  to  Reduce  the  Rate  of  Turn  to  Less 
Than  or  Equal  to  0.1  Degree  Per  Second 

In  response  to  the  rudder  failure,  each  subject  had  to  jse 
his  shiphandling  ability  to  reduce  ownship's  rate  of  turn 
(ROT).  The  time  it  took  each  subject  after  the  ruddei 
failure  to  reduce  the  ROT  to  less  than  oi  equal  to  0.1 
degree  second  was  calculated  in  seconds.  Wheie  0.1  degree 
second  was  not  attained,  the  minimum  ROT  was  used. 
These  data  were  also  reported  f oi  those  subjects  who  had 
collisions  as  well  as  those  who  had  not. 

Collision  with  Piers 

This  performance  measure  indicated  whether  ownship 
collided  with  the  piers  after  successfully  negotiating  the 
turn  aiound  the  anchored  ships  resulting  from  i udder 
failures. 


Leg  2  —  Training  Objective:  Negotiating  a  51  Degree  Turn 
with  Passing  Ship  Effect 

CPA  (in  Feet)  to  Ship  3,  Outbound  Containership 

Ship  3  was  an  outbound  containership  which  ownship  had 
to  avoid.  The  CPA  was  reported  in  feet. 

Average  Swept  Path  (in  Feet) 

The  average  value  of  ownship's  swept  path  measured  m 
feet  throughout  Leg  2  was  computed. 

The  maximum  value  of  swept  path  reached  m  Leg  2  by 
each  subject  was  also  determined.  This  measuie  is  moie 
sensitive  than  average  swept  path  since  large  values  ate  not 
"washed  out"  by  smaller  values,  as  m  the  case  of  average 
swept  path. 
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Average  Ratio  Swept  Path 

The  average  swept  path  in  feet  was  divided  tty  the  channel 
width  to  create  a  measure  which  indicates  the  percent^ 
of  channel  width  taken  up  by  ownship. 

Maximum  Ratio  Swept  Path 

This  measure  was  similar  to  that  described  above;  however, 
the  maximum  swept  path  was  used  in  the  numerator  rather 
than  the  average. 

Grounding 

The  distance  between  the  keel  of  ownship  and  the  channel 
bottom  was  monitored  throughout  this  leg.  Whenever  this 
distance  reached  zero,  a  grounding  was  considered  to  have 
occurred.  The  scenario,  however,  continued  until  a  collision 
occurred  or  until  normal  termination. 

Leg  3  —  Training  Objective:  Negotiating  a  129  Degree  Turn 
Around  Shoal  with  Oncoming  Traffic 

Average  Swept  Path  (in  Feet) 

This  was  computed  in  a  manner  similar  to  Leg  2. 

Maximum  Swept  Path  (in  Feet) 

This  was  computed  in  a  manner  similar  to  Leg  2. 

Average  Ratio  Swept  Path 

This  was  computed  in  a  manner  similar  to  Leg  2. 

Maximum  Ratio  Swept  Path 

This  was  computed  in  a  manner  similar  to  Leg  2. 

Grounding 

These  measures  were  computed  in  a  manner  similar  to 
Leg  2. 

CPA  (in  Feet)  to  Ship  8,  Tug-Tow 

Ship  8  was  a  tug-tow  approaching  ownship  in  Leg  3.  Where 
CPA  was  equal  to  zero,  a  collision  occurred.  CPA  to  Ship  8 
was  reported  for  those  subjects  who  had  collisions  and 
those  who  had  not. 


Leg  4  -  Training  Objective:  Shiphandling  in  Response  to 
Propulsion  Failure  in  Vicinity  of  Bridge  and  Shoal 

Grounding  on  Shoal 

These  data  were  lepoMed  for  those  subjects  who  grounded 
out  and  those  who  did  not  It  is  a  dichotomous  variable. 

Collision  with  Railroad  Bridge 

This  is  a  dichotomous  variable;  either  a  subject  hit  the 
bridge  or  he  did  not. 

Safe  Completion  of  Transit 

A  subiect  was  considered  to  have  safely  completed  the 
transit  if  he  did  not  ground  out  oi  collide  with  the  bridge. 

2.4  APPROACH  TO  EVALUATION  OF 
PERFORMANCE  MEASURES 

A  measure  which  can  be  used  as  a  valid  test  of  shiphandling 
ability  must  first  and  foremost  be  sensitive  to  degrees  of 
proficiency  in  shiphandling.  In  order  to  demonstrate  the 
sensitivity  of  a  performance  measure,  one  must  show  either 
that  experts  differ  from  novices  with  respect  to  that 
measure,  or  that  the  score  achieved  by  a  novice  on  that 
measure  will  change  in  a  favorable  direction  as  a  result  of 
training. 

The  performance  measures  utilized  in  Phase  3  were  selected 
because  previous  CAORF  research  indicated  their  sensitiv¬ 
ity  to  training  or  because  they  appeared  to  be  directly 
related  to  the  training  objectives.  However,  in  order  for 
a  measure  to  be  used  as  a  standard  for  evaluating  ship¬ 
handling  proficiency,  it  must  be  sensitive  to  degrees  of 
proficiency.  Thus,  expert  shiphandlers  should  perform 
differently  than  novices  on  any  measure  used  to  evaluate 
shiphandling. 

With  this  in  mind,  a  strategy  for  evaluat'ng  each  perform 
ance  measure  was  adopted,  A  flow  chart  of  this  strategy 
appears  in  Figure  2-4.1 . 

The  first  issue  in  evaluating  each  performance  measure 
dealt  with  whether  or  not  most  experts  (pilots)  performed 
better  than  most  novices  (masters)  with  respect  to  that 
measure.  It  was  difficult  to  answer  this  question  when  only 
14  of  each  group  were  used  as  representatives.  Any  statisti¬ 
cal  test  used  to  evaluate  differences  between  ihese  groups 
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Figure  2  4.1 . 


Strategy  for  Evaluating  Each  Performance  Measure 


1 1 


must  deal  with  a  skewed  distribution  of  scores  and  the  loss 
of  statistical  power  associated  with  small  sample  size 
(Cohen.  1969), 

If  the  scores  were  normally  distnbuted,  then  the  t  test  for 
independent  samples  would  tie  the  appropriate  test  of 
group  differences.  If  the  population  variances  weie  unequal, 
the  foimula  for  computing  it  should  be  modified  according 
to  the  method  described  by  Cochran  ami  Cox  (1954). 
If  the  scores  were  not  normally  distributed,  then  the 
Mann  Whitney  U  test  is  most  appropriate  (Siegel,  1956). 
These  two  statistical  techniques  should  yield  quite  similar 
p  values  (probability  of  occurrence  by  choice)  when  the 
distributions  of  scores  aie  approximately  normal. 

Ttie  next  maior  issue  in  evaluating  the  perfoimance  meas¬ 
ures  was  to  establish  a  cutoff  score  for  each  measure.  This 
cutoff  score  should  reflect  the  difference  between  the 
performance  of  experts  (pilots)  and  novices  (masters). 
To  accomplish  this,  a  90  peicent  confidence  interval  was 
drawn  aiound  the  mean  of  the  pilots.  The  lower  limit  of 
this  confidence  interval  reflected  the  lowest  value  that 
the  pilots'  mean  could  be,  given  a  90  percent  level  of 
confidence.  Using  this  value  as  a  cutoff  score,  the  data 
were  reanalyzed  to  determine  the  proportions  of  pilots  and 
masters  who  scored  better  than  this  value. 

For  a  performance  measure  to  be  valid,  a  larger  proportion 
of  experts  should  "achieve"  the  cutoff  score  compared  to 
novices.  Therefore,  a  2  x  2  contingency  table  was  created 
for  each  measure.  This  table  reflected  the  number  of  pilots 
who  scored  (letter  than  the  cutoff  scores  (achieved  cti 
tenon)  or  worse  than  the  cutoff  score  (did  not  achieve 
criterion)  arid  the  number  of  masters  who  did  likewise. 
In  order  to  determine  whether  the  proportion  of  pilots  who 
achieved  criterion  was  significantly  greater  than  the  propor¬ 
tion  of  masters  who  achieved  criterion,  a  \?  statistic  was 
computed.  Whore  the  smallest  expected  frequency  in  the 
2x2  table  was  less  than  five,  the  Yates  correction  formula 
for  y’  was  applied  (Feiguson,  1976).' 

All  p  levels  reported  in  this  paper  are  for  one  tailed  tests, 
since  this  research  was  only  interested  in  establishing  per¬ 
formance  criteria  above  the  mean  of  the  masters.  Thus, 
only  one  direction  was  of  interest. 


2.5  RESULTS 

Leg  A  -  Harbor  Approach  -  Training  Ob|ective: 
Shiphandling  in  Harbor  Approach 

Five  performance  measures  were  evaluated  in  order  to 
determine  a  subject's  ability  to  handle  ovvnship  in  a  harbor 
approach  situation  where  an  important  turn  buoy  was 
off  station.  Each  subject's  actual  track  plot  is  shown  m 
Figures  A-1  through  A  14  foi  masters  and  Figures  A  15 
through  A  28  for  pilots 

a.  Harbor  Approach  -  Recognition  of  Buoy  Off  Station 

The  off  station  buoy  was  particularly  important  since  it 
matked  the  turn  in  the  middle  of  a  separation  zone.  It  is 
indicated  in  each  plot  by  a  black  dot  in  the  vicinity  where 
each  ship  altered  course.  Some  subjects  who  noticed  that 
the  buoy  was  off-station  passed  on  the  left  side  of  the  buoy 
in  ordei  to  stay  in  the  lane.  Other  subjects  who  recognized 
that  the  buoy  was  off-station  passed  on  the  right  side  of 
the  buoy.  This  occurred  even  though  the  subject  noticed 
the  placement  error  so  as  not  to  confuse  an  oncoming 
vessel.  This  procedure  is  not  incorrect  since  ownship  is 
in  open  waters  and  thoie  is  no  other  immediate  danger. 
A  determination  was  made  as  to  which  sublets  noticed 
that  the  buoy  was  off  station  and  a  summary  of  these  data 
appears  in  Table  2-5.1. 


TABLE  2  5.1.  NUMBER  OF  SUBJECTS  WHO 
NOTICED  BUOY  OFF  STATION  AND  POSITION 
OF  BUOY  DURING  TRANSIT  LEG  A, 
HARBOR  APPROACH 


Noticed 

Passed  With 

Did  Not 

Buoy 

Buoy  On 

Notice  Buoy 

Right 

Left 

Masteis 

6 

3 

3 

8 

Pilots 

13 

1 1 

2 

1 

'The  authors  of  this  report  are  quite  awaie  of  the  arguments  regarding  the  appropriateness  of  V  when  small  frequencies 
occur  Results  are  given  with  and  without  Yates  correction  when  the  smallest  expected  frequency  is  less  than  five  The 
interested  reader  should  consult  Bradley  et  al  ,  1979,  for  a  succinct  treatment  of  this  topic.  Ferguson  11976,  P  201),  Siegel 
1 1956,  p.  78) ,  and  Hayes  (1973,  p.  725)  also  provide  discussions  of  this  mattei 
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With  the  exception  of  one  subject,  all  pilots  noticed  the 
buoy  disciepancy.  In  contrast,  moie  than  half  of  the 
masteis  did  not  notice  that  the  buoy  was  incorrectly 
located.  A  chi  square  analysis  pioved  these  differences  to 
be  significant  (\‘(1)  8  02,  p  <  0.01).  Thus,  this  measuie 

appears  paiticulaily  valuable  in  distinguishing  master  and 
pilot  behavioi  in  approaching  a  new  harboi. 

b.  Harbor  Approach  —  Mean  Deviation  Off  Centerline  - 

This  measure  yielded  significant  differences  between  the 
perfoi mance  of  masters  ( x  -  1028.6  and  pilots  (x  -  767.4). 
A  Mann  Whitney  analysis  yielded  a  U(14,  14)  -  65, 
p  0.001  The  adoption  of  the  lowei  end  of  the  90  per 
center  confidence  interval  about  the  mean  for  pilots  (906.3 
feet)  as  an  achievement  criterion  shows  a  significant  number 
of  pilots  having  achieved  this  criterion  (11  of  14).  The 
proportion  of  masters  and  pilots  who  achieved  thisscoie  is 
significantly  different  (\2(1)  -  5.25,  p  <  0.0251  and 
suggests  that  mean  deviation  off  centerline  should  be 
considered  as  a  criterion  for  simulator  training  with  respect 
to  the  characteristics  defining  this  leg.  Statistical  details 
and  graphic  representation  of  the  data  are  given  in  Figuies 
A  29  through  A  31 . 

c.  Harbor  Approach  —  Maximum  Deviation  (in  feet)  Off 

Centerline  -  The  masters'  and  pilots'  scores  on  this  measure 
were  not  significantly  different  (x  =  2324  and  x  1915, 
respectively).  The  lack  of  significance  is  most  likely  due  to 
the  wide  variation  of  scores  within  each  group.  Howevei, 
when  the  90  percent  confidence  limit  is  calculated  and  a 
criterion  score  derived  (2289  feet),  11  pilots  achieve  this 
score  compared  to  five  masters.  These  proportions  are 
significantly  diffeient  (\2(1)  5.25,  p  •  0.025).  These 

data  are  summarised  in  Figure  A  31  and  shown  graphically 
in  Figure  A  32. 

d.  Harbor  Approach  —  Mean  Deviation  (in  feet)  Off 
Average  Trackline  An  average  tiacklme  for  this  leg  was 
computed  for  masters  and  pilots  Due  to  mechanical 
recording  failures,  the  data  from  two  subjects  could  not 
he  included  in  the  average  track  foi  pilots,  Theiefoie. 
all  data  and  analyses  concerning  pilot  performance  is 

■  based  on  an  N  12  lather  than  14 

i 

i 

|  The  composite  tracklines  for  masters  and  pilots  ate  shown 

in  Figures  2  5.1  and  2-5.7  and  appear  almost  identical 
indicating  that,  on  the  average,  froth  masters  and  pilots 
approached  the  harbor  entrance  in  the  same  manner  The 
coordinates  of  the  composite  tiackline  foi  each  gioup 
served  as  the  basis  for  the  calculation  of  mean  deviation 


(in  feet)  and  maximum  deviation  (m  feet).  The  mean 
deviation  off  aveiage  tiacklme  is  lepoited  below. 

An  analysis  of  the  data  shows  (Figure  A  33)  that  the  mean 
deviation  foi  masters  referenced  from  then  own  tiackline 
was  520  feet  while  pilots  only  deviated  on  the  aveiage  of 
300  feet.  The  difference  between  these  scores  is  significant 
( t ( 24 )  2.82,  p  ■  0.01)  and  indicates  that  pilots  tend  to 
vaiy  then  approach  to  the  harbor  less  than  masters.  The 
90  percent  cutoff  score,  384  feet,  resulted  in  ten  of  the 
twelve  pilots  achieving  criterion  while  only  five  of  fourteen 
masteis  reached  this  level.  These  proportions  differ  signifi 
cantly  (\2  -  6.00,  p  <  0.01 )  and  indicate  that  this  measure 
should  be  considered  in  defining  adequate  performance. 
These  results  are  shown  graphically  in  Figure  A  34. 

e.  Harbor  Approach  —  Maximum  Deviation  (in  feet)  Off 
Average  Trackline  -  Since  mean  deviation  (see  above)  and 
maximum  deviation  scores  are  related,  it  is  not  surpiismg 
to  also  find  significant  differences  in  maximum  deviation 
off  aveiage  tiackline  between  masters  and  pilots.  The  mean 
maximum  deviation  for  masters  was  1920  feet  and  foi 
pilots  was  1079  feet.  The  resulting  t -  test  yielded  signifi 
cance  at  p  <  0.01  ( t  ( 24 )  2.99).  Details  of  the  data  are 

shown  in  Figure  A-35. 

Using  a  90  percent  cutoff  score  of  1455  feet,  8  of  12  pilots 
achieved  criterion  and  only  3  of  14  masters  achieved  cri¬ 
terion.  These  proportions  are  sufficiently  different  (\? 
5.42,  p  ■  0.051  to  warrant  consideration  of  this  measuie 

as  a  disci iminatoi  of  performance  between  masteis  and 
pilots.  Graphic  representation  of  the  data  is  given  in 
Figure  A  36 

Summary  of  Leg  A  Harbor  Approach 

Pet  foi  mance  measures  useful  as  naming  criteria: 

•  Recognition  of  buoy  off  station 

•  Mean  deviation  off  centei  line 

•  Maximum  deviation  off  centeilme 

•  Mean  deviation  off  average  tiacklme 

•  Maximum  deviation  off  aveiage  tiacklme 
Performance  measuiex  not  useful  as  tia-ning  ciitena 

•  None 
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COMPOSITE  TRACK  -  CHANNEL  A  MASTERS 


Figure  2-5.1.  Composite  Trackline,  Masters,  Leg  A 


COMPOSITE  TRACK  -  CHANNEL  A  PILOTS 


Composite  Trackline,  Pilots,  Leg  A 


Leg  1  -  Rudder  Failure  -  Objective:  Shiphandling  in 
Response  to  Rudder  Failure  in  Confined  Waters 

Tiack  plots  aic  shown  in  Figuies  B  I  tluough  B  14  loi  .ill 
niasteis  and  in  Figuies  B  15  tluough  B  28  foi  all  pilots. 
The  plots  show  course  of  ownship  with  respect  to  the 
thiee  stationaiy  ships  anti  the  closest  land  mass.  The 
run  them -most  anchoietl  ship  was  designated  Ship  3,  and 
the  vessel  anchoietl  somewhat  below  was  designated  Ship  4. 
CPA  data  excluding  anti  including  collisions  was  calculated 
foi  both  these  ships.  The  truck  plots  show  the  obvious 
problems  wr.lt  which  subjects  went  factttl  aftei  the  mddei 
(dilute.  Subjects  were  pnmanly  concerned  with  gaining 
sufficient  contiol  ot  ownship  to  avoid  hitting  Ships  3  oi  4 
and,  aftei  dealing  them,  to  avoitl  colliding  with  the  pieis. 
In  all,  six  performance  measures  weie  analyzed  in  evalu¬ 
ating  his  objective. 

a.  Rudder  Failure  —  CPA  to  Ship  3  The  data  foi  this 
measuie  weie  calculated  in  two  ways.  The  fiist  included 
those  subjects  who  collided  with  anchored  Ship  3,  and  the 
second  analysis  excluded  these  individuals.  A  summaiy  of 
these  data  is  presented  in  Figures  B  29  and  8  31  (those  who 
collided  with  Ship  31  and  Figures  B  30  and  B  32,  respec 
tively  (those  who  did  not  collide  with  Ship  3),  This 
information  is  detailed  in  Table  2  5.2. 

Table  2-5.2  shows  that  in  general  pilots  experienced  mote 
collisons  thari  masters.  Excluding  these  four  pilots  and  one 
mastei,  the  lesulting  average  CPA  of  the  lemainmg  subjects 
showed  no  significant  differences.  However,  when  all 
subjects  are  considered,  regardless  of  whethei  they  collided 
or  not,  the  difference  between  the  group  means  (x  < >f 
masters  326  feet  and  x  of  pilots  188  feet)  was  signdi 
cant,  t  ( 26)  1  825,  p  0  05  show  pilot  and  mastei  mean 

CPAs  The  90  percent  confidence  limits  were  calculated 
for  both  cases  (including  and  excluding  collisions)  and 


TABLE  2  5  2.  MEAN  CPA  (IN  FEET)  TO  SHIP  3, 
LEG  1,  RUDDER  FAILURE 


'p  0  05 


cutoff  semes  calculated.  The  numtrei  o*  pilots  and  masters 
achieving  tins  enter  ion  score  was  then  counted.  In  both 
cases  the  proportion  of  mastei s  achieving  criterion  was  not 
significantly  diffeient  from  that  of  pilots 

b.  Rudder  Failure  —  CPA  to  Anchored  Ship  4  Tfiese 

data,  detailed  in  Figures  B  33  and  B  34,  show  masters 
(x  1075.9  feet)  achieving  a  laigei  CPA  than  pilots 
(x  922.8  feet)  with  a  significant  difference  between  these 
two  means  (t  (26)  1 .926,  p  ■  0.05)  Using  a  cutoff  score 

of  826.9  feet,  masters  and  pilots  did  not  diffei  in  the  pro 
poitions  who  scored  above  and  below  this  cutoff.  (See 
Figure  B  32.) 

c.  Rudder  Failure  —  Time  (in  seconds)  to  Reduce  Speed 
Over  Ground  to  Less  Than  2  Knots  These  data  weie  also 
calculated  including  collisions  (Figuie  B  35)  and  excluding 
collisions  (Figures  B  37  and  B  38). 

The  diffeience  between  the  means  ot  each  gi oup  excluding 
those  sublets  who  collided  pioved  non  significant.  How- 
evei ,  when  all  subjects  ate  taken  into  account,  the  differ¬ 
ence  between  these  means  was  significant  ( t  ( 26)  1.88, 

p  '  0  05.  The  use  of  the  lowoi  end  of  the  pilot  90  pel  cent 
confidence  mteival  as  a  cutoff  resulted  in  11  of  14  pilots 
and  6  ol  14  mastei s  equalling  oi  surpassing  this  score.  The 
diffeience  between  these  proportions  is  significant  (\?I1I 
3.74,  p-  0  10) 

It  should  be  noted  that  pilots  experienced  more  collisions 
than  masters  and  the  scores  of  the  pilots  who  collided 
tended  to  be  m  the  lowei  lange  of  the  group,  thus,  they 
contributed  toward  making  the  pilots'  performance  appear 
bettei  than  the  masteis'.  Since  whether  a  subject  has  a  col 
Iisioii  oi  not  is  the  ultimate  measure  of  good  shiphandling, 
it  appeals  valid  to  compute  the  scores  excluding  collisions 
in  this  instance.  When  this  is  done,  no  significant  diffeience 
appeals  m  any  of  the  calculated  statistics  and  it  becomes 
doubtful  whethei  oi  not  this  measure  is  of  much  use  in 
setting  standards  for  tiainmg. 

d.  Rudder  Failure  —  Time  (in  seconds)  to  Reduce  Rate  of 
Turn  to  Less  Than  or  Equal  to  0.1  /Sec.  The  utility  of 
this  petformance  measuie  appeals  questionable.  Scoies  of 
masteis  and  pilots  were  fan  ly  evenly  intetspetsed  through 
out  the  range  and  none  ot  the  statistical  tests  showed  any 
sigmficnce.  This  was  tiue  whethei  the  scoies  included  ot 
excluded  those  sublets  who  had  a  collision.  A  summaiy 
of  these  data  appears  in  Figures  B  39  through  B  42. 
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e.  Rudder  Failure  -  Collision  with  Piers  Only  two 
masters  (no  pilots)  collided  with  the  land  and  01  pieis 
following  a  successful  dealing  of  Ship  3,  This  points  to 
a  possible  superiority  in  pilots,  but  it  is  difficult  to  make 
any  inference  with  such  a  small  sample  size. 

f.  Rudder  Failure  —  Collision  with  Either  Ships  or  Piers 

The  number  of  pilots  and  masters  who  collided  with  either 
anchored  Ship  3,  anchored  Ship  4,  or  the  pieis  was  calcu 
lated.  In  total,  four  pilots  and  three  masters  collided  with 
one  of  the  three  structures  referenced  above  This  differ 
ence  is  not  statistically  significant  and,  therefore,  this 
measure  does  not  appear  to  be  useful  as  a  training  criterion. 

Summary  of  Leg  1  —  Rudder  Failure 

Performance  measures  useful  as  training  criteria: 

•  Time  to  reduce  speed  (including  collisions) 

Performance  measures  not  useful  as  training  criteria: 

•  CPA  to  Ship  3  (including  collisions) 

•  CPA  to  Ship  3  (excluding  collisions) 

•  CPA  to  Ship  4 

•  T ime  to  reduce  speed  (excluding  collisions) 

•  Time  to  reduce  rate  of  turn  (excluding  collisions) 

•  Collision  with  piers 

•  Collisions  with  either  ship  or  pier 

Bridge  Behavioral  Data  for  Leg  1,  Rudder  Failure  -  In 

general,  masters  tended  to  exhibit  slightly  more  thruster 
activity  than  pilots  (30  thruster  orders  for  masters  versus 
22  for  pilots).  As  expected,  the  majority  of  thruster  activity 
for  both  groups  occurred  immediately  following  the  rudder 
failure  Masters  and  pilots  appeared  to  differ  in  the  manner 
in  which  each  grojp  responded  to  the  rudder  emergency. 
Pilots  used  a  higher  percentage  of  orders  calling  for  "full” 
thrusters  (72  percent)  than  masters,  where  only  60  percent 
of  thruster  orders  given  were  for  "full."  The  use  of  "full” 
thrusters  by  pilots  extended  throughout  the  run.  All  pilot 
orders  (with  the  exception  of  one)  were  for  "full”  or 
"zero"  thrusters.  In  contrast,  masters  occasionally  used 
3/4  or  1/2  thruster  during  this  leg.  In  (act,  during  the  first 
third  of  the  run,  and  immediately  following  the  rudder 


lailuie,  not  one  pilot  used  the  thrusters  m  any  other  mode 
except  "full.”  It  IS  not  until  four  oi  moie  minutes  alter 
the  lailuie  that  pilots  reduce  thiustei  activity.  In  summary, 
both  gioups  responded  to  the  rudder  failure  with  thrustei 
activity,  but  pilots  tended  to  take  moie  definitive  action 
when  the  emergency  occurred. 

A  review  of  engine  ordeis  ahead  showed  a  very  clear  pattern 
of  activity  for  each  group  of  subjects.  Pilots  gave  almost 
twice  as  many  orders  as  masters  (62  versus  351.  Not  only 
were  orders  given  more  frequently  by  the  pilots,  but  they 
tended  to  be  laiget  as  well  lx  engine  oideis  foi  pilots 
equals  20.90  RPM,  x  engine  orders  for  masteis  equals 
16.40  RPM).  Pilots  also  did  not  hesitate  to  use  full  engine 
RPM  and  then  revert  back  to  "zeio”  rathei  than  3  4,12, 
or  1  4  speed  in  an  attempt  to  conti  ol  ownship  aftei  the 
lailuie. 

The  distribution  ol  engine  orders  astern  did  not  show  any 
appreciable  difference  in  the  behavior  of  masters  and  pi  lots . 
For  both  gioups,  the  greatest  numbei  of  commands  (ovei 
55  percent)  occurred  directly  after  the  failure,  indicating 
a  realistic  response  to  the  emeigency. 

The  amount  of  ruddet  remaining,  engine  RPM  lemaming, 
and  thruster  remaining  were  summarized  lot  all  masters 
and  pilots.  These  measures  indicate  the  amount  ol  mddei 
RPMs,  and  thiustei  power  available  to  the  subject  f<n 
emergency  use.  The  amount  of  ruddet  lemaming  was 
calculated  by  subtracting  the  maximum  available  rudder 
(35  )  from  the  average  amount  used,  and  then  dividing  the 
absolute  value  of  this  difference  scoie  by  the  maximum 
available  rudder  (35  ).  RPM  and  thrustei  remaining  wen: 
calculated  m  a  similar  way,  substituting  the  appropriate 
values  for  maximum  available  RPM  and  thiustei.  No  dif 
ferences  in  the  performance  of  masters  and  pilots  -.veie 
found  for  these  measures.  (See  Figure  B  43.) 

Leg  2—5'  Turn  —  Training  Objective.  Negotiating  a 
51  Turn  with  Passing  Ship  Effects 

Six  performance  measures  were  collected  lot  this  sgement. 
The  task  of  the  subject  was  to  mani  jvei  ownship  thiough 
a  51  turn  while  passing  an  outbound  containeiship  up 
proaching  the  channel  bend  from  the  othei  direction.  The 
actual  track  plots  foi  all  masters  appeal  on  the  right  hand 
side  ol  Figures  C  1  through  C  14  and  (oi  pilots  in  Figures 
C-15  thiough  C  28.  In  these  plots,  both  the  channel  hound 
aries  and  centoi  trackline  are  shown,  hut  the  outbound 
tanker  is  not  indicated.  The  track  plots  on  the  left  of  each 
chart  represent  Leg  3  and  will  be  subsequently  detailed. 
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j.  CPA  to  Ship  3-51  Turn  —  (Outbound  Containership) 

The  average  CPA  lot  masters  (x  487.3  feet)  did  not 
littei  siym t icon tl v  (tom  the  average  CPA  lot  pilots  (x 
504.5  feet  I .  In  addition,  the  lower  end  ot  the  pilots'  90  pei 
tent  confidence  mteiv.il  as  a  cutoff  Yielded  no  significant 
liffeiences  in  piopoi'ion  ot  masters  and  pilots  who 
ichieved  oi  did  not  achieve  this  criterion  The  data,  how 
'vei ,  aie  included  for  lefeience  in  Figures  C  29  and  C  30. 

).  51  Turn  -  Maximum  Swept  Path  The  scores  in  this 
neasuie  varied  veiy  little  between  maste.s  and  pilots  (see 
igures  C  31  anil  C  32)  A  90  percent  confidence  interval 
utoff  score  dici  not  result  in  significantly  different  piopor 
ions  of  masteis  and  pilots  who  exceeded  this  score. 

51  Turn  -  Average  Swept  Path  The  scoies  foi 
veiage  swept  path  loi  masteis  and  pilots  also  did  not 
liffei  significantly  (see  Figures  C  33  and  C  34).  Theiefore, 
'O  generalisations  can  Ire  made  about  the  relative  peiform 
nee  of  the  two  groups  based  on  this  measuie. 

I  51  Turn  -  Maximum  Ratio  Swept  Path  This  meas 
'ie  also  did  not  yield  any  meaningful  results.  Figures  C  35 
nd  C  36  are  a  summary  of  the  data. 

51  Turn  —  Average  Ratio  Swept  Path  This  measure 
'elded  no  statistically  significant  results.  Figures  C-37  and 
38  show  the  means  and  standard  deviations  fot  troth 
oups.  A  \‘  test  comparing  the  proportions  of  masteis 
id  pilots  who  achieved  ciitenon  based  on  a  90  percent 
rnfidence  limit  also  proved  nonsignificant. 

51  Turn  —  Groundings  An  analysis  ot  the  numlrei 
>  groundings  in  this  leg  ii'vealed  that  thiee  masteis  and 
vo  pilots  gioumled  ownship  dunng  the  run.  Because  this 
fference  is  insignificant,  little  can  he  detei  mined  horn 
ns  mfoi  matnin 

i  summary,  all  ot  the  above  ii'easuies  pioved  insufficient 
»  distinguish  between  the  performance  of  masters  and 
riots.  Therefore,  within  the  context  of  this  paiticulai 
enano  these  measures  do  not  hold  much  promise  as 
i term  foi  hauling. 

ummary  of  Performance  Measures  in  Leg  2,  51  Turn 

’er formarree  measures  useful  as  training  criteria: 

»  None 


Pei  fin  malice  measures  not  useful  as  naming  entenj 

•  CPA  to  outbound  contameiship 

•  Maximum  swept  oath 

•  Avetage  swept  path 

•  Maximum  ratio  swept  path 

•  Average  ratio  swept  path 

Analysis  of  Bridge  Activity  in  Leg  2,  51  Turn  An  exalte 
nation  of  budge  behavior  shows  that  sublets  ,n  both 
gioups  gave  the  most  mddei  orders  about  halfway  through 
the  fust  section  of  this  leg.  A  secondary  spun  at  the  end  of 
this  section  and  a  tapenng  off  in  activity  foi  the  rest  ot  the 
tun  was  also  evident  (see  Figures  C  39,  C  40.  and  C  41s. 
Tin  ’se  graphic  1 1  lust  i  at  ions  show  that  troth  gioups  oideted 
almost  an  identical  numlrei  o<  full  "gin  oi  full  left  mdder 
ordets.  Howevei.  pilots  tended  to  give  mine  "midships" 
oideis  than  masteis,  especially  dunng  the  middle  thud  of 
the  urn  f  Figure  C  40).  No  other  distinct  patterns  of  actn  .tv 
wen;  incognizable  in  this  leg. 

Masteis  and  pilots  also  did  not  show  any  difteiences  n 
luddei,  engine,  and  thiustei  pi  i cent  lema'iimit.  Means  id 
each  measuie  ate  given  in  Figme  C  42  and  t  tests  o'  the 
data  yielded  no  significant  comparisons 

Leg  3  -  129  Turn  -  Training  Objective:  Negotiating  a 
129  Turn  Around  Shoal  with  Oncoming  Traffic 

Five  performance  measures  weie  calculated  foi  this  leg  and 
(with  the  exception  ol  CPA  to  contameiship)  weie  identical 
to  the  ones  detailed  m  the  anlaysis  of  Leg  2.  The  actual 
hacks  foi  this  leg  ate  show  on  the  left  side  ol  the  plots  in 
Figures  C  l  through  C  14  (masteis)  and  Figures  C  15  to 
C  28  (pilots). 

a.  129  Turn  -  Maximum  Ratio  Swept  Path  This  meas 
uie  yielded  meaningful  insults.  The  ildfeience  between 
the  means  ol  masteis  (x  7,031  and  pilots  (x  0  664)  was 
significant  (p  ■  0.05b  (See  Figute  D  5.)  A  cutoff  scene 

baser)  on  the  90  percent  confidence  limits  yielded  ten  pilots 
(of  14)  and  five  masteis  (of  14)  who  exceeded  this  ci  i 
tenon  These  piopoitions  aie  significantly  different  (V 
3.59,  p  ■  0.05)  and  indicate  the  potential  use  of  this 

measuie  to  ddfeientiate  performance  of  master  and  pilots. 
The  frequency  data  aie  summatized  and  illustiated  in 
Figuies  D  5  and  D  6,  inspect ively. 
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b.  129  Turn  —  Maximum  Swept  Path  The  results  ot 

this  measure  are  summaii/ed  m  Figure  D  1  The  mean 
maximum  swept  path  for  masters  (x  534  feet)  is  not 
statistically  different  from  that  of  pilots  (x  514  feet). 
It  the  lower  end  of  the  pilot's  90  percent  confidence  intei 
val  (534.7  teetl  is  used  as  a  cntenon,  13  ot  14  pilots  and 
only  7  of  14  masters  achieved  this  score  The  difference 
between  these  proportions  is  significant  (V  4  38, 
p  0.025)  and  is  graphically  shown  in  Figure  D  2 

c.  129  Turn  —  Average  Ratio  Swept  Path  An  analysis 

of  this  measure  shows  that  the  difference  between  the 
means  i  '  froth  groups  was  not  statistically  significant 
(Figures  D7  anti  D  8l.  There  were  also  no  statistically 
significant  differences  between  the  proportions  of  pilots 
and  masters  who  achieved  a  cutoff  score  clenved  from 
the  90  pei cent  confidence  interval. 

d  129  Turn  —  Average  Swept  Path  -  No  significant 
differences  between  masters  and  pilots  were  found  foi  this 
measure.  The  data  for  this  leg,  however,  are  shown  for 
reference  in  Figures  D  3  and  D  4. 

e.  129  Turn  —  Number  of  Groundings  -  In  this  leg,  two 
pilots  and  three  masters  grounded.  These  data  are  msuffi 
cient  to  provide  a  basis  for  discriminating  between  the 
performance  of  masters  and  pilots. 

Summary  of  Performance  Measures  for  Leg  3,  129  Turn 

Per  foi rnance  measures  useful  as  tiammg  enter ia: 

•  Maximum  swept  path 

•  Maximum  ratio  swept  path 

Performance  measuies  not  useful  as  training  criteria: 

•  Average  swept  path 

•  Average  ratio  swept  path 

Analysis  of  Bridge  Activity  in  Leg  3,  129  Turn  An 

analysis  was  made  of  both  rudder  and  engine  orders  foi 
this  leg.  The  analysis  included  such  factors  as  magnitude 
of  response,  time  of  response,  positron  of  ownship,  and 
number  of  orders  given.  No  distinguishable  patterns  of 
rudder  and  engine  activity  were  found.  Thus,  it  appears 
that  the  bridge  behavior  of  masters  and  pilots  is  similar 
for  this  leg. 


No  difference  bet  ween  masters  and  pilots'  percent  remain 
mg  of  rudder,  engine,  and  thrusters  was  found.  Derails 
of  these  measures  are  given  in  Figure  D  9 

Leg  4  —  Propulsion  Failure  —  Training  Objective:  Ship 
handling  in  Response  to  Propulsion  Failure  in  Vicinity  of 
Bridge  and  Shoal 

This  leg  investigated  how  masters  and  pilots  responded  to 
an  emergency  situation,  that  of  propulsion  failure  The 
two  primary  tasks  to  ownship  were  to  avoid  grounding 
on  the  shoal  as  the  ship  approached  the  bridge  and  to 
avoid  colliding  with  the  bridge  itself.  The  track  plots 
appear  in  Figures  E  1  through  E  14  for  all  masters  and 
Figures  E  l  5  through  E  28  for  all  pilots. 

a.  Propulsion  Failure  —  Safe  Completion  of  Transit  -  Of 

14  phots  tested,  eight  pilots  did  not  ground  on  the  shoal 
nor  hit  the  bridge  and,  therefore,  were  considered  to  have 
safely  completed  the  transit.  Flowevet,  of  the  14  masters 
tested,  only  three  completed  the  transit  without  a  casualty. 
These  proportions  differ  significantly  (\2(1)  3.74. 

p  -  0.1 01  and  support  the  adoption  of  this  measure  as  a 

performance  criterion, 

b.  Propulsion  Failure  —  Grounding  on  Shoal  Of  the  14 

subjects  m  each  group,  a  total  of  two  pilots  anti  five  masters 
grounded  on  the  shoal  A  chi  square  analysis  of  these  data 
does  not  yield  significance  (\2(1|  1 .71 1.  Thus,  the  use  of 

grounding  on  the  shoal  as  a  perfotmance  measure  does  not 
adequately  discriminate  shiphandling  ability  of  masters  and 
pilots  dur ing  this  specific  emergency. 

c.  Propulsion  Failure  —  Collisions  with  Bridge  Of  the 

subjects  who  did  not  ground  on  the  shoal,  Six  out  of  the 
remaining  nine  masteis  hit  the  bridge  while  foui  of  the 
remaining  12  pilots  hit  the  bridge.  This  difference  is  not 
significant  (\2(1)  2.29)  and  indicates  that  this  patbcula’ 

measure  does  not  appear  to  be  useful  as  a  performance 
criterion. 

Summary  of  Leg  4,  Propulsion  Failure 

Pei  for  rnance  measuies  useful  as  training  entet  ia. 

•  Safe  completion  of  transit 

Performance  measures  not  useful  as  training  criteria 

•  Groundings  on  shoal 

•  Collisions  with  bridge 
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Summary  of  Bridge  Activity,  Propulsion  Failure  While 

theie  was  virtually  no  difference  m  the  total  number  of 
ruddei  oidets  given,  it  was  appaiem  that  masters  tended 
to  give  more  rudder  orders  before  the  failure  than  pilots 
After  the  failuie,  pilots  tended  to  give  more  orders  than 
masters.  An  examination  uf  the  action  taken  directly  after 
the  propulsion  failure  indicates  some  interesting  differences 
in  strategy.  In  terms  of  rudder  use,  pilots  revert  back  to 
"midships"  more  frequently  than  do  masters  in  recovering 
from  the  failure,  and  a  higher  percentage  of  pilots  than 
masters  called  for  full  thrusters.  It  appears  that  pilots, 
leading  to  the  failure,  prefer  to  use  the  thruster  rather 
than  the  rudder  to  control  ownship.  Masters  tend  to  rely 
on  both  in  maneuvering  the  vessel  in  this  situation. 

The  percent  remaining  of  rudder,  engine,  and  thiustei  foi 
masters  and  pilots  did  not  differ  significantly  between 
these  groups.  Details  are  reported  in  Figure  E  29. 

2  6  DISCUSSION  OF  RESULTS 
AND  CONCLUSIONS 

The  harbor  approach  leg  (Leg  A!  emerged  as  the  all-around 
rest  discriminator  between  expert  shiphandleis  (pilots) 
ind  relatively  inexperienced  shiphandleis  (chief  mates 
ipgradmg  to  masters). 

The  fact  that  13  pilots  and  only  six  masters  recognized 
hat  the  turn  buoy  used  for  harbor  approach  was  off  station 
uggests  that  pilots  are  more  attentive  to  environmental 
ues.  Since  none  of  the  pilots  belonged  to  the  Sandy  Flook 
Mot  Association,  they  could  not  have  relied  on  local 
nowledge  to  notice  the  off  station  buoy.  (Port  XYZ  was 
modification  of  New  York  Harbor.)  Rathei ,  one  can  infei 
hat  the  expert  shiphandler  pays  close  attention  to  publica 
ions  such  as  notices  to  mariners  and  relies  on  more  than 
me  indicator  of  position.  A  simulator  training  program 
.an  use  the  recognition  of  an  off  station  buoy  as  a  valid 
raining  objective.  A  successful  tiaimng  program  should 
how  greater  attention  to  navigational  arris  aftei  tiaimng. 

'he  haiboi  approach  leg  also  yielded  data  indicating  that 
xpert  shiphandleis  are  more  consistent  and  accurate  at 
.rackkeeping  compared  to  relatively  inexperienced  ship 
landlers.  The  mean  and  maximum  deviations  off  the 
■.enterline,  as  well  as  average  tiackline,  emerged  as  sensitive 
neasuies  of  shiphandling  proficiency. 

Every  measure  of  performance  applied  to  the  harbor 
ipproach  leg  yielded  differences  between  pilots  and  masters 


and  yielded  a  enter  ion  score  which  successfully  discnmi 
nated  between  these  groups.  These  criterion  scores  can  only 
be  applied  to  the  specific  scenario  used  in  Leg  A.  However , 
one  can  expect  that  when  graduates  uf  other  simulator 
training  programs  are  placed  in  this  haiboi  approach 
scenario,  then  performance  can  tv  compared  to  the 
standards  established  through  the  Pfiase  3  u-seaich 

In  Leg  1,  a  rudder  failuie  occurred  as  ownslnp  passed  by 
three  anchoied  ships.  Tile  position  of  the  i udder  was  stuck 
in  a  hard  left  position.  Only  thiough  the  piopei  use  of 
engine  and  thrusters  could  ownship  keep  from  colliding 
with  eithei  the  anchoied  ships  or  the  piers.  Four  pilots  and 
one  master  eventually  collided  with  an  anchoied  ship,  while 
no  pilots  and  two  masters  collided  with  the  piers.  Whethei 
an  average  of  three  to  four  collisions  foi  every  14  rudder 
failure  scenarios  can  be  considered  a  "good"  or  "hail" 
record  is  not  known.  These  data  may  simply  reflect  a 
reality  that,  given  this  scenario  in  the  teal  woild.  28  pci  cent 
of  the  time  a  collision  would  result.  Thus,  the  event  of  a 
collision  failed  to  distinguish  between  pilots'  and  masters' 
emergency  shiphandling  abilities.  While  these  results  aie 
initially  surprising,  a  closer  look  at  the  subjects  provides  an 
explanation.  The  pilots  were  selected  by  then  associations 
for  then  excellent  recotds  as  local  shiphandleis  However, 
the  degree  to  which  then  expertise  was  based  on  focai 
knowledge  and  the  degiee  to  which  it  was  based  on  raw 
shiphandling  ability  was  not  known  Therefoie,  the  pilots 
who  collided  may,  in  fact,  besupeiioi  shiphandleis  in  then 
own  areas,  but  this  superiority  does  not  completely  tunsfei 
to  a  new  environment.  Likewise,  one  would  have  naively 
expected  more  than  just  thiee  masters  to  have  collided 
Howevei,  masters  were  not  selected  specifically  foi  then 
lack  of  proficiency  in  shiphandling.  lathei,  they  were 
selected  for  the  length  of  time  they  held  then  licenses. 
Some  of  the  masters  may  actually  have  been  quite  piofi 
cient  at  shiphandling,  thus  improving  the  oveiall  neifoim 
ance  of  the  masters  as  a  group. 

The  best  mcasuie  of  expertise  n  emergency  shiphandling 
was  the  amount  of  time  it  took  a  subject  to  induce  own 
ships  speed  over  the  ground  to  mss  than  2  knots  alfei  the 
ruddei  failure  occuned  Since  the  thrusters  'reeded  to  gam 
control  aftei  the  ludder  failure  iveie  maximally  effective 
at  lower  speeds,  the  quickness  with  which  a  subject  could 
reduce  the  speed  nl  ownship  was  considered  a  relevant 
measuie  of  emergency  shiphandling.  The  pilots  and  masteis 
differed  significantly  with  inspect  to  this  measure,  and  the 
cutoff  score  derived  from  tins  measuie  successfully  dis 
eliminated  between  experts  anil  novices. 
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In  conclusion,  piohciency  in  emeigency  shiphandliny  m 
i  espouse  to  a  luddei  failure  in  confined  waters  can  be 
effectively  gauged  using  the  time  it  takes  to  induce  own 
ship's  speed  as  a  pel  loim^ricn  measuie. 

Shiphandliny  thiough  a  turn  was  examined  using  a  51  turn 
with  passing  ship  effects  in  Leg  2  and  a  129  piecision  turn 
in  Leg  3.  The  number  of  gioundings  experienced  by  pilots 
and  masteis  did  not  diffei  in  these  logs .  This  lack  of  differ 
ence  is  casualties  is  similar  to  that  reported  in  Ley  1  and 
tends  to  confirm  the  explanation  provided  in  the  discussion 
of  that  leg. 

Overall,  the  51  turn  did  not  yield  differences  in  perform 
ance  between  masters  and  pilots.  This'  may  he  due  to  a  pool 
selection  of  pet  for  manat  measures  (i.o.,  insensitive  to 
differences  in  abilities),  to  pool  scenario  design  (i.e.,  not 
sufficiently  difficult  to  extract  differences  in  ability),  oi 
to  an  maccutdte  assumption  that  proficient  shiphandliny  is 
necessary  to  piopeily  execute  a  51  turn  with  passing  ship 
effects.  The  lattei  explanation  (i.e.,  inaccuiate  assump 
tions)  is  piobably  not  the  case,  since  three  masteis  and  two 
pilots  grounded  ownship  during  the  scenario,  indicating 
that  at  least  a  modest  amount  of  shiphandling  ability  is 
necessary  to  negotiate  the  51  turn. 

The  more  precise  and  difficult  129  turn  of  Leg  3  was  a 
much  better  disci iminatoi  of  shiphandling  ability.  Both 
maximum  ratio  swept  path  and  maximum  swept  path 


emerged  as  successful  disci  iminatois  of  shiphandliny 
proficiency.  Th"  cutoff  scores  obtained  through  the 
analysis  of  the  data  should  serve  as  useful  standards  of 
simulator  pei  formance 

The  approach  to  a  railroad  bridge  in  tile  vicinity  of  j  shoal, 
followed  by  a  propulsion  failure,  constituted  the  emergency 
shiphandliny  scenario  of  Ley  4.  Five  masters  and  two 
pilots  grounded  on  the  shoal.  Six  ot  the  remaining  nine 
masteis  and  foui  of  the  lemaminy  12  pilots  proceeded  to 
hit  the  railroad  bridge.  While  these  differences  were  not 
statistically  significant,  they  indicate  a  definite  trend  in  the 
data.  The  trust  disci imination  of  emeiyency  shiphandling 
ability  hi  this  paiticului  scenario  was  the  numbei  of 
subjects  who  successfully  completed  the  hansit  with  no 
casualties.  Eight  of  the  pilots  anti  only  three  of  the  masteis 
emeiged  unscathed.  This  measure  is  a  statistically  valid 
discrimnatoi  which  should  piove  useful  m  establishing 
pei  foi  mance  standards. 

In  summaiy,  the  Phase  3  reseat ch  was  designed  to  establish 
performance  standards  for  simuletoi  training  ol  chief  mates 
upgrading  to  masteis.  Five  different  scenarios  incut  pot  at' 
mg  numerous  training  objectives  weie  presented  to  pilots 
(expert  shiphandlers)  anti  masteis  (potential  tiameesl  and 
then  shiphandling  abilities  weie  measured  Foui  of  the  five 
seen ji i os  yielded  statistically  valid  peifoimano  sia’idaids. 
The  methodology  and  results  of  the  research  die  reported 
in  detail  in  the  text  and  appendices. 
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APPENDIX  A 


PERFORMANCE  MEASURES  APPENDICES 
LEG  A  -  HARBOR  APPROACH 

TRAINING  OBJECTIVE  -  SHIPHANDLING  IN  HARBOR  APPROACH 

LIST  OF  ILLUSTRATIONS 

Number 

A  1  to  A  14  Tuck  Plots.  Masteis,  Ley  A,  Harbor  Approach 

A  1  5  to  A  28  Track  Plots,  Pilots.  Ley  A,  Harbor  Approach 

A  29  SummaiY  of  Data  ami  Contingency  Table,  Moan  Deviation  (in  feet)  Off  Centerline,  Leg  A,  Harbor  Approach 

A  30  Frequency  Distribution  and  Confidence  Interval,  Mean  Deviation  (in  feet)  Off  Centerline,  Ley  A,  Harbor 

Approach 

A  31  SummaiY  of  Data  and  Contingency  Tattle,  Maximum  Deviation  (in  feet)  Off  Centerline,  Leg  A,  Haibor 

Approach 

A  32  Frequency  Distribution  and  Confidence  Interval,  Maximum  Deviation  (in  feet)  Off  Centerline,  Ley  A,  Harbor 

Approach 

A  33  Summary  of  Data  and  Contingency  Table,  Mean  Deviation  (in  feet)  OH  Average  Tuckline,  Ley  A,  Hdihoi 

Appioach 

A  34  Frequency  Distribution  anil  Confidence  Interval,  Mean  Deviation  (in  feet)  Off  Average  Tracklme,  Leg  A, 

Harbor  Approach 

A -35  Summary  of  Data  and  Contingency  Table,  Maximum  Deviation  (in  feet)  Oft  Aveiaye  Tracklme,  Leg  A, 

Harbor  Appioach 


A  36 


Frequency  Distribution  and  Confidence  Interval,  Maximum  Deviation  (in  feet)  Off  Aveiye  Tracklme,  Ley  A 
Harbor  Approach 


START  TIME  18  0:12  STOP  TIME  18  14:12  TIME  INTERVAL  0: 1 :0 


Harbor  Approach 


START  TIME  18  0:0  STOP  TIME  18:16:0  TIME  INTERVAL  0: 1  0 


Masters,  Leg  A,  Harbor  Approach 


START  TIME  18  0  12  STOP  TIME  18  17  12  TIME  INTERVAL  0:1:0 


Figure  A-4.  Track  Plots,  Masters,  Leg  A,  Harbor  Approach 


7223S19  RUN  NO  3  HARBOR:  NONE 

START  TIME  18:0:12  STOP  TIME  18:15:12  TIME  INTERVAL  0: 1 :0 


*  • 


4=1  <=a  a  <=>  C3  <=l 


<=i  <=3  a 


Masters,  Leg  A,  Harbor  Approach 


START  TIME  18:0:12  STOP  TIME  18:16:12  TIME  INTERVAL  0  1  0 


Figure  A  6.  Track  Plots,  Masters,  Leg  A,  Harbor  Approach 


7226  S2S  RUN  NO.  8  HARBOR:  NONE 

START  TIME  18:0:0  STOP  TIME  18:17:0  TIME  INTERVAL  0:1:0 


36 


Figure  A-11.  Track  Plots,  Masters,  Leg  A,  Harbor  Approach 


START  TIME  18  0:12  STOP  TIME  18:17:12  TIME  INTERVAL  0: 1  0 


Figure  A  12.  Track  Plols,  Masters,  Leg  A,  Harbor  Approach 


START  TIME  18:0  12  STOP  TIME  18:15:12  TIME  INTERVAL 


Figure  A  13.  Track  Plots,  Masters,  Leg  A,  Harbor  Approach 


7232  S28  RUN  NO.  4  HARBOR:  NONE 

START  TIME  18:0:0  STOP  TIME  18:18:0  TIME  INTERVAL  0:1:0 


Masters,  Leg  A,  Harbor  Approach 


START  TIME  t8:0:0  STOP  TIME  18.13  0  TIME  INTERVAL  0  1  0 


Figure  A  15,  Track  Plots,  Pilots,  Leg  A,  Harbor  Approach 


Harbor  Approach 


START  TIME  18:0:0  STOP  TIME  18  13  0  TIME  INTERVAL  0:1:0 


Harbor  Approach 


7218  S11  RUN  NO.  1  HARBOR:  NONE 

START  TIME  18:0:36  STOP  TIME  18:13:36  TIME  INTERVAL  0:1:0 


rack  Plots,  Pilots,  Leg  A,  Harbor  Approach 


START  TIME  18:0:12  STOP  TIME  18  17:12  TIME  INTERVAL  0:1 :0 


Figure  A-22.  Track  Plols,  Pilots,  Leg  A,  Harbor  Approach 


13  RUN  NO.  10  HARBOR:  NONE 

TIME  18:0:12  STOP  TIME  18:15:12  TIME  INTERVAL  0:1:0 


23  Track  Plots,  Pilots,  Leg  A,  Harbor  Approach 


Figure  A-24.  Track  Plots,  Pilots,  Leg  A,  Harbor  Approach 


7221  S16  RUN  NO.  1  HARBOR:  NONE 

START  TIME  18  0:0  STOP  TIME  18:15:0  TIME  INTERVAL  0:1:0 


Figure  A  26.  Track  Plots,  Pilots,  Leg  A,  Harbor  Approach 


7221  S17  RUN  NO.  6  HARBOR:  NONE 

START  TIME  18:0:0  STOP  TIME  1818:0  TIME  INTERVAL  0:1:0 


Figure  A-27.  Track  Plots,  Pilots,  Leg  A,  Harbor  Approach 


START  TIME  18:0:12  STOP  TIME  18:1  :12  TIME  INTERVAL  0:1.0 


Figure  A-28.  Track  Plots,  Pilots,  Leg  A,  Harbor  Approach 
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TRAINING  OBJECTIVE:  Harbor  Approach 
PERFORMANCE  MEASURE:  Mean  Deviation  (in  feet)  Off  Centerline 


Masters  Pilots 


X 


SO 

90% 

Confidence 
In  terval 


1028.55 


548.65 


1288.55  to  769.45 


757,43 

315.64 


906.32  to  607  .68 


Cutoff  Score:  >  906.32.  Subjects  with  scores  >  906.32  are 
considered  not  to  have  achieved  criterion. 


Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

11 

3 

Masters 

5 

9 

\7  =  5.25.  p  '■  0.025 

\J  -  (with  Yates  Correction) 

3  65,  p<  0.05 

Figure  A-29.  Summary  of  Data  and  Contingency  Table,  Mean  Deviation  (in  feet)  Off  Centerline, 

Leg  A,  Harbor  Approach 


ACHIEVED  CRITERION  LEVEL 


Figure  A-30.  Frequency  Distribution  and  Confidence  Interval,  Mean  Deviation  (in  feet)  Off  Centerline,  Leg  A,  Harbor  Approach 


TRAINING  OBJECTIVE:  Harbor  Approach 


PERFORMANCE  MEASURE:  Maximum  Deviation  (in  feet)  Off  Centerline 


X 


SD 

90% 

Confidence 

Interval 


Masters  Pilots 


2324 

1915 

1232 

791 

2906,81  to  1741.19 

2289.18  to  1540.82 

Cutoff  Score:  >  2289.18.  Subjects  with  scores  >  2289.18 
are  considered  not  to  have  achieved  criterion. 


Pilots 

Masters 


Achieved  Criterion  Not  Achieved  Criterion 


11 

3 

5 

9 

X2  5.25,  p<  0.025 

X2  (with  Yates  Correction)  =  3.65,  p  <  0.05 


Figure  A-31.  Summary  of  Data  and  Contingency  Table,  Maximum  Deviation  (in  feet)  Off  Centerline, 

Leg  A,  Harbor  Approach 
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INTERVAL  (PILOTS) 


Figure  A-32.  Frequency  Distribution  and  Confidence  Interval,  Maximum  Deviation  (in  feet)  Off  Centerline,  Leg  A,  Harbor  Approach 


TRAINING  OBJECTIVE:  Harbor  Approach 


PERFORMANCE  MEASURE:  Mean  Deviation  (in  feet)  Off  Average  Trackline 


X 


SD 

90% 

Confidence 

Interval 


Pilots 

Masters 


Masters 

Pilots* 

520.12 

300.40 

231.28 

164.22 

629.52  to  410.72 

384.31  to  216.48 

Cutoff  Score:  >  384.31.  Subjects  with  scores  '  384.31  are 
considered  not  to  have  achieved  criterion. 

Achieved  Criterion 

Not  Achieved  Criterion 

10 

2 

5 

9 

X2  =  6.00,  p  <  0.01 

X2  =  (with  Yates  Correction)  =  4 .21 ,  p  0.05 
* N  =  1 2,  see  text  page  26, 


Figure  A-33.  Summary  of  Data  and  Contingency  Table,  Mean  Deviation  (in  feet)  Off  Average  Tracklme, 

Leg  A,  Harbor  Approach 
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90%  CONFIDENCE  INTERVAL  IPILOTSI 


Figure  A-34.  Frequency  Distribution  and  Confidence  Interval,  Mean  Deviation 


TRAINING  OBJECTIVE:  Harbor  Approach 
PERFORMANCE  MEASURE:  Maximum  Deviation  (in  feet)  Off  Average  Trackline 


X 

SO 

90% 

Confidence 

Interval 


Pilots 
Masters 

X2  =  5.42,  p<  0.05 

X2  =  (with  Yates  Correction)  -  3.72,  p  <  0.1 0 


Achieved  Criterion  Not  Achieved  Criterion 


8 

4 

3 

11 

Masters  Pilots 


1920.30 

1079.30 

690.24 

735.44 

2246.61  to  1593.79 

1455.07  to  703.52 

Cutoff  Score:  >  1455.07.  Subjects  with  scores  >  1455.07 
are  considered  not  to  have  achieved  criterion. 


Figure  A-35.  Summary  of  Data  and  Contingency  Table,  Maximum  Deviation  (in  feet)  Off  Average  Trackline, 

Leg  A,  Harbor  Approach 
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90%  CONFIDENCE  INTERVAL  (PILOTS) 


n  o 
o  cr> 

<N  r*. 

cn  o 


c 

o 

X 

<N 


O 

9 

fN 


X) 

O 

u0 

CN 

CN 


^3 

O 

in 

CD 


X) 

O 

in 

ro 


in 

o 

in 


in 

o 

in 


in 

c 

in 


r 


AONBOOBEH 


62 


Figure  A  36.  Frequency  Distribution  and  Confidence  Interval,  Maximum  Deviation  (in  feet)  Off  Averge  Trackline,  Leg  A,  Harbor  Approach 


APPENDIX  B 


PERFORMANCE  MEASURES  APPENDICES 
LEG  1  -  RUDDER  FAILURE 

TRAINING  OBJECTIVE:  SHIPHANDLING  IN  RESPONSE  TO  RUDDER  FAILURE 

IN  CONFINED  WATERS 


The  uack  plots  (Figures  B  1  thiough  B-281  which  follow  depict  the  position  of  ownship  with  lespect  to  three  anchored  ships. 
In  this  scenario,  ownship  experienced  a  rudder  failure  jamming  the  rudder  at  1  5  degrees  left.  By  properly  using  thruster  and 
engine  power  the  mastei  could  avoid  colliding  with  any  of  the  three  anchored  ships  or  any  of  the  piers  depicted  to  the  left 
of  each  track  plot.  A  representation  of  ownship  was  plotted  at  one  minute  intervals.  Thus,  five  representatives  of  ownship 
in  the  track  plot  indicate  ownship's  position  over  a  foui  minute  period.  (A  representation  of  ownship  is  always  provided 
foi  starting  position.)  The  x  and  y  coordinate  scales  are  references  to  position  in  the  data  base. 


LIST  OF  ILLUSTRATIONS 

Number 

B  1  to  B  14  Track  Plots,  Master,  Leg  1 ,  Rudder  Failure 
B-1  5  to  B  28  Track  Plots,  Pilots,  Leg  1 ,  Rudder  Failure 

B  29  Summary  of  Data  and  Contingency  Table,  CPA  (in  feet)  to  Ship  3  Including  Collisions,  Leg  1,  Ruddei 

Failure 

B  30  Frequency  Distribution  and  Confidence  Interval,  CPA  (m  feet)  to  Ship  3  Including  Collisions,  Leg  1 ,  Ruddei 

Failure 

B  31  Summary  of  Data  and  Contingency  Table,  CPA  (in  feet)  to  Ship  3  Excluding  Collisions,  Leg  1,  Ruddei 

Failure 

B  32  Frequency  Distribution,  CPA  (in  feet)  to  Ship  3  Excluding  Collisions,  Leg  1 ,  Rudder  Failure 

B  33  Summary  of  Data  and  Contingency  Table,  CPA  (in  feel)  to  Ship  4,  Leg  1 ,  Ruddei  Failure 

B  34  Frequency  Distribution  and  Confidence  Interval,  CPA  (in  feet)  to  Ship  4,  Leg  1,  Ruddei  Failuie 

B-35  Summary  of  Data  and  Contingency  Table,  Time  (in  seconds)  to  Reduce  Speed  Over  Giound  to  Less  Than 

2  Knots  Including  Collisions,  Leg  1,  Ruddei  Failure 

B  36  Frequency  Distribution  and  Confidence  Interval,  Time  (in  seconds)  to  Reduce  Spevu  Ovei  Ground  to  Less 

Than  2  Knots  Including  Collisions,  Leg  1,  Ruddei  Failure 
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LIST  OF  ILLUSTRATIONS  (Continued) 


Number 

B  37  Summary  of  Data  and  Contingency  Table,  Time  (in  seconds)  to  Reduce  Speed  Over  Ground  to  Less  Than 

2  Knots  Excluding  Collisions,  Leg  1,  Rudder  Failure 

B  38  Frequency  Distribution,  Time  (in  seconds)  to  Reduce  Speed  Over  Ground  to  Less  Than  2  Knots  Excluding 

Collisions,  Leg  1,  Rudder  Failure 

B-39  Summary  of  Data  and  Contingency  Table,  Time  (in  seconds)  to  Reduce  Rate  of  Turn  to  More  Than 

0.1  /Second  Including  Collisions,  Leg  1,  Rudder  Failure 

B  40  Frequency  Distribution,  Time  (in  seconds)  to  Reduce  Rate  of  Turn  to  More  Than  0.1  /Second  Including 

Collisions,  Leg  1.  Rudder  Failure 

B-41  Summary  of  Data  and  Contingency  Table,  Time  (in  seconds)  to  Reduce  Rate  of  Turn  to  More  Than 

0.l7Second  Excluding  Collisions,  Leg  1,  Rudder  Failure 

B-42  Frequency  Distribution,  Time  (in  seconds)  to  Reduce  Rate  of  Turn  to  More  Than  0.1/Second  Excluding 

Collisions,  Leg  1,  Rudder  Failure 

B-43  Percent  of  Rudder,  Engine  RPM.and  Thruster  Remaining,  Leg  1,  Rudder  Failure 


64 


7209  S2  RUN  NO.  12  HARBOR.  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:8:12  TIME  INTERVAL  0:1:0 


Figure  B-2.  Track  Plots,  Masters,  Leg  1,  Rudder  Failure 


7210  S3  RUN  NO.  4  HARBOR:  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:7:12  TIME  INTERVAL  0:1.0 


Figure  B-3.  Track  Plots,  Masters,  Leg  1,  Rudder  Failure 


7223  S19  RUN  NO.  4  HARBOR:  KILLVAN 

START  TIME  10:0:0  STOP  TIME  10:15:0  TIME  INTERVAL  0:1:0 


Figure  B-5.  Track  Plots,  Masters,  Leg  1,  Rudder  Failure 


7223  S20  RUN  NO.  10  HARBOR:  KILLVAN 

START  TIME  10:0:0  STOP  TIME  10:15:0  TIME  INTERVAL  0:1:0 


Figure  B-6.  Track  Plots,  Masters,  Leg  1,  Rudder  Failure 


7224  S21  RUN  NO.  3  HARBOR:  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:15:12  TIME  INTERVAL  0:1:0 


Masters,  Leg  1,  Rudder  Failure 


7224  S22  RUN  NO.  2  HARBOR:  KILLVAN 

START  TIME  10.0:12  STOP  TIME  10:14:12  TIME  INTERVAL  0:1:0 


Figure  B-8.  Track  Plots,  Masters,  Leg  1,  Rudder  Failure 


7225  S23  RUN  NO.  2  HARBOR:  KILLVAN 

START  TIME  10:0:0  STOP  TIME  10:12:0  TIME  INTERVAL  0:1:0 


Masters,  Leg  1,  Rudder  Failure 


7226  S24  RUN  NO.  4  HARBOR:  KILLVAN 

START  TIME  10.0:0  STOP  TIME  10:15:0  TIME  INTERVAL  0:1:0 


Masters.  Leg  1.  Rudder  Failure 


7226  S25  RUN  NO.  9  HARBOR:  KILLVAN 

START  TIME  101012  STOP  TIME  10  15:12  TIME  INTERVAL  0:1 :0 


Figure  B  11.  Track  Plots,  Masters,  Leg  1,  Rudder  Failure 


7227  S26  RUN  NO.  2  HARBOR:  KILLVAN 

START  TIME  10:0:0  STOP  TIME  10:15:0  TIME  INTERVAL  0:1 :0 


Figure  B-12.  Track  Plots,  Masters,  Leg  1,  Rudder  Failure 


7227  S27  RUN  IMO.  7  HARBOR:  KILLVAN 

START  TIME  10:0:0  STOP  TIME  10:15:0  TIME  INTERVAL  0:1:0 


Masters,  Leg  1,  Rudder  Failure 


7232  S28  RUN  (MO.  5  HARBOR.  KILLVAN 

START  TIME  10:0:12  _ STOP  TIME  10:14:12  TIME  INTERVAL  0:1:0 


Masters,  Leg  1,  Rudder  Failure 


7213  S5  RUN  NO.  5  HARBOR:  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:15:12  TIME  INTERVAL  0:1:0 


Rudder  Failure 


7214  S6  RUN  NO.  3  HARBOR.  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:14:12  TIME  INTERVAL  0: 1 :0 
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Figure  B  16.  Track  Plots,  Pilots,  Leg  1,  Rudder  Failure 


7216  S7  RUN  NO.  2  HARBOR:  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:14:12  TIME  INTERVAL  0:1:0 


Figure  B-17.  Track  Plots,  Pilots,  Leg  1,  Rudder  Failure 


7216  S8  RUN  NO.  7  HARBOR:  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:14:12  TIME  INTERVAL  0:1:0 


Rudder  Failure 


Figure  B  19.  Track  Plots.  Pilots,  Leg  1,  Rudder  Failure 


7217  S10  RUN  NO.  10  HARBOR:  KILLVAN 

START  TIME  10:1:0  STOP  TIME  10:6:0  TIME  INTERVAL  0:1:0 


Rudder  Failure 


7218  S11  RUN  NO.  2  HARBOR:  KILLVAN 

START  TIME  10:0:0  STOP  TIME  10:15:0  TIME  INTERVAL  0:1:0 


Rudder  Failure 


7219  S12  RUN  NO.  6  HARBOR:  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:14:12  TIME  INTERVAL  0:1:0 


Rudder  Failure 


7219S13  RUN  NO.  11  HARBOR:  KILLVAN 

START  TIME  10:0:0  STOP  TIME  10:11:0  TIME  INTERVAL  0:1:0 


Rudder  Failure 


Figure  B-24.  Track  Plots,  Pilots,  Leg  1,  Rudder  Failure 


7220  S15  RUN  NO.  8  HARBOR:  KILLVAN 

START  TIME  10:0:12  STOP  TIME  10:5:12  TIME  INTERVAL  0:1:0 


Figure  B-25.  Track  Plots,  Pilots,  Leg  1,  Rudder  Failure 


7221  S16  RUN  NO.  2  HARBOR:  KILLVAN 

START  TIME  10:0:0 _  STOP  TIME  10:15  0  TIME  INTERVAL  0: 1 :0 
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Figure  B-26.  Track  Plots,  Pilots,  Leg  1,  Rudder  Failure 
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7221  S17  RUN  NO.  7  HARBOR.  KlLLVAN 

START  TIME  10.0:0  STOP  TIME  10:15:0  TIME  INTERVAL  0:1.0 


Figure  B-27,  Track  Plots,  Pilots,  Leg  1,  Rudder  Failure 


7222  S18  RUN  NO.  2  HARBOR:  KILLVAN 

START  TIME  10:0:0  STOP  TIME  10:15:0  TIME  INTERVAL  0: 1 :0 


Figure  B-28.  Track  Plots,  Ptlols,  Leg  1,  Rudder  Failure 


TRAINING  OBJECTIVE:  Rudder  Failure 


PERFORMANCE 


X 

SO 

90% 

Confidence 

Interval 


Pilots 

Masters 


I 


1 


MEASURE:  CPA  (in  feet)  to  Ship  3,  Including  Collisions 


Masters  Pilots 


326.34 

188.23 

207.99 

189  73 

256.57  to  446.18 

360.48  to  16 

_ 

Cutoff  Score:  >  199.91.  Subjects  with  scores  >  199.91  are 
considered  not  to  have  achieved  criterion. 


Achieved  Criterion  Not  Achieved  Criterion 


9 

5 

12 

2 

X 7  -  (with  Yates  Correction)  =  0.762,  not  significant 


Figure  B-29.  Summary  of  Data  and  Contingency  Table,  CPA  (in  feet)  to  Ship  3  Including  Collisions, 

Leg  1,  Rudder  Failure 


ACHIEVED  CRITERION  LEVEL 


Frequency  Distribution  and  Confidence  Interval,  CPA  (in  feet)  to  Ship  3  Including  Collisions,  Leg  1,  Rudder  Failure 


1 


TRAINING  OBJECTIVE:  Rudder  Failure 
PERFORMANCE  MEASURE:  CPA  (in  feet)  to  Ship  3,  Excluding  Collisions 


X 


SD 

90% 

Confidence 

Interval 


Masters  Pilots 


351.38 

263.7 

193.13 

172.9 

256.57  to  446.18 

166.91  to  360.48 

Cutoff  Score:  >  166.31.  Subjects  with  scores  >  166.91  are 
considered  not  to  have  achieved  criterion. 


Pilots 

Masters 


Achieved  Criterion  Not  Achieved  Criterion 


7 

3 

12 

1 

X2  =  (with  Yates  Correction)  =  0.713,  not  significant 


Figure  B-31 .  Summary  of  Data  and  Contingency  Table,  CPA  (in  feet)  to  Ship  3  Excluding  Collisions, 

Leg  1 ,  Rudder  Failure 
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Figure  B  32  Frequency  Distribution,  CPA  (in  feet)  to  Ship  3  Excluding  Collisions,  Leg  1,  Rudder  Failure 


TRAINING  OBJECTIVE:  Rudder  Failure 


PERFORMANCE  MEASURE:  CPA  (in  feet)  to  Ship  4 


X 


SD 

90% 

Confidence 

Interval 


Pilots 

Masters 


Masters 

Pilots 

1075.93 

922.82 

217.58 

202.69 

1178.85  to  973.00 

1018,70  to  R?<5.94 

Cutoff  Score 

Are  considered  not  to 

have  achieved  criterion. 

Achieved  Criterion 

Not  Achieved  Criterion 

7 

3 

12 

1 

X 7  -  (with  Yates  Correction)  = 

0.762,  not  significant 

Figure  B-33.  Summary  of  Data  and  Contingency  Table,  CPA  (in  feet)  to  Ship  4,  Leg  1,  Rudder  Failure 
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frequency 


ACHIEVED  CRITFRION  LEVEL 


600  5  800  5  1000  5  1200  5  1400  5 


Figure  B-34.  Frequency  Distribution  and  Confidence  Interval,  CPA  (in  feet)  to  Ship  4,  Leg  1,  Rudder  Failure 
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TRAINING  OBJECTIVE:  Rudder  Failure 


PERFORMANCE  MEASURE:  Time  (in  seconds)  to  Reduce  Speed  Over  Ground  to  <  2  Knots  Including  Collisions 


X 


SD 

90% 

Confidence 

Interval 


Masters  Pilots 


520.14 

437.14 

133.35 

136.96 

583.22  to  457.05 

501.92  to  372.36 

L 

Cutoff  Score:  >  501.92.  Subjects  with  scores  >  501.92  are 
considered  not  to  have  achieved  criterion. 


Pilots 

Masters 


Achieved  Criterion  Not  Achieved  Criterion 


' 

11 

3 

6 

8 

X2  =  3.74,  p<  0.10 

X2  -  (with  Yates  Correction)  =  2.39,  not  significant 


Figure  B-35.  Summary  of  Data  and  Contingency  Table,  Time  (in  seconds)  to  Reduce  Speed  Over  Ground 
to  Less  Than  2  Knots  Including  Collisions,  Leg  1 ,  Rudder  Failure 
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ACHIEVED  CRITERION  LEVEL 


Figure  B-36.  Frequency  Distribution  and  Confidence  Interval,  Time  (in  seconds)  to  Reduce  Speed  Over 
Ground  to  Less  Than  2  Knots  Including  Collisions,  Leg  1,  Rudder  Failure 


TRAINING  OBJECTIVE:  Rudder  Failure 


PERFORMANCE  MEASURE:  Time  (in  seconds)  to  Reduce  Speed  Over  Ground  to  <  2  Knots,  Excluding  Collisions 


X 


SD 

90% 

Confidence 

Interval 


Masters 

Pilots 

525.83 

474,54 

86.88 

131.05 

570.1  1  to  481.54 

544.47  to  404.68 

Cutoff  Score:  -■  544.47.  Subjects  with  scores  >  544.47  art- 
considered  not  to  have  achieved  criterion. 


Achieved  Criterion  Not  Achieved  Criterion 

Pilots 
Masters 

\?  -  0.524,  not  Significant 
\2  (with  Yates  Correction) 


Figure  B-37.  Summary  of  Data  and  Contingency  Table,  Time  (in  seconds)  to  Reduce  Speed  Over  Ground 
to  Less  Than  2  Knots  Excluding  Collisions,  Leg  1,  Rudder  Failure 
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FREOUFNCY 


Figure  B-38.  Frequency  Distribution,  Time  (in  seconds)  to  Reduce  Speed  Over  Ground  to 
Less  Than  2  Knots  Excluding  Collisions,  Leg  1,  Rudder  Failure 
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TRAINING  OBJECTIVE.  Rudder  Failure 


PERFORMANCE  MEASURE:  Time  to  Reduce  Rate  of  Turn  -  0.1  /Sec.,  Including  Collisions 


X 

SD 

90% 

Confidence 

Interval 


Masters 

Pilots 

229  7 

205  7 

85  1 

66  3 

269  95  to  189  45 

237.06  to  174  33 

Cutoff  Score:  '•  237.06.  Subjects  with  scores  >  237.06  are 
considered  not  to  have  achieved  criterion. 


Achieved  Criterion  Not  Achieved  Criterion 

Pilots 
Masters 

X2  (with  Yates  Correction!  0.655,  not  significant 


11 

ro 

j 

_ _ 

1  CO 

1 

6 

Figure  B-39.  Summary  of  Data  and  Contingency  Table,  Time  (in  seconds)  to  Reduce  Rate  of  Turn 
to  More  Than  0,1  /Second  Including  Collisions,  Leg  1,  Rudder  Failure 
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90  CONFIDENCE  INTERVAL  IPILOTSi 


Frequency  Distribution,  Time  (in  seconds)  to  Reduce  Rate  of  Turn  to  More  Than  0.1  /Second  Including  Collisions, 

Leg  1,  Rudder  Failure 


TRAINING  OBJECTIVE:  Rudder  Failure 


PERFORMANCE  MEASURE:  Time  to  Reduce  Rate  of  Turn  '  0.1  /Sec.,  Excluding  Collisions 


Masters  Pilots 


X 

217  0 

207  6 

SD 

56  85 

74.63 

90% 

------ 

175.20  to  258.71 

165.80  to  249.37 

Intei  val 

. -----  - - 

Cutoff  Score:  ">  249.37,  Subjects  with  scores  '•  249.37  are 
considered  not  to  have  achieved  criteiion. 


Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

8 

2 

Masters 

8 

4 

\7  (with  Yates  Correction)  0.047,  not  significant 


Figure  B  41 .  Summary  of  Data  and  Contingency  Table,  Time  (in  seconds)  to  Reduce  Rate  of  Turn 
to  More  Than  0.1  /Second  Excluding  Collisions,  Leg  1,  Rudder  Failure 
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FREQUENCY 


Figure  B-42.  Frequency  Distribution,  Time  (in  seconds)  to  Reduce  Rate  of  Turn  to  More  Than  0.1  /Second 

Excluding  Collisions,  Leg  1,  Rudder  Failure 
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Masters 


Pilots 


Figure  B-43 


Rudder 

RPM  Ahead 

RPM  Astern 

Thruster 

X 

75.8 

74  79 

38.91 

17.95 

S.D. 

30.40 

25.76 

21.07 

23.28 

n 

4 

.  . 

14 

11 

14 

X 

51.5 

73.64 

38.17 

16.29 

S.D. 

42.13 

27.96 

19.22 

16.71 

n 

6 

14 

12 

14 

t  ’ 

0.987 

0.112 

0.088 

0  217 

df 

8 

26 

21 

26 

’All  comparisons  of  means  for  Masters  and  Pilots  are  not  significant. 


Percent  of  Rudder,  Engine  RPM,  and  Thruster  Remaining,  Leg  1,  Rudder  Failure 
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APPENDIX  C 


PERFORMANCE  MEASURES  APPENDICES 
LEG  2  -  51°  TURN 

TRAINING  OBJECTIVE:  NEGOTIATING  A  51°  TURN  WITH  PASSING  SHIP  EFFECTS 


LIST  OF  ILLUSTRATIONS 


Number 

C  l  to  C  14 
C -15  to  C  28 
C-29 
C  30 
C- 31 
C  32 
C  33 
C  34 
C  35 
C  36 
C  37 
C  38 
C  39 
C  40 
C  41 
C  42 


Track  Plots,  Masters,  Leg  2,  51  Turn  and  Leg  3,  129°  Turn 
Track  Plots,  Pilots,  Leg  2,  51  Turn  and  Leg  3,  129"  Turn 

Summary  of  Data  and  Contingency  Table,  CPA  (in  feet)  to  Ship  3,  Leg  2,  51  Turn 
Frequency  Distribution,  CPA  (in  feet)  to  Ship  3,  Leg  2,  51  Turn 

Summary  of  Data  and  Contingency  Table,  Maximum  Swept  Path  (in  feet),  Leg  2,  51  Turn 

Frequency  Distribution,  Maximum  Swept  Path  (in  feet),  Leg  2,  5T  Turn 

Summary  of  Data  and  Contingency  Table,  Average  Swept  Path  (in  feet).  Leg  2,  51  Turn 

Frequency  Distribution  Maximum  Ratio  Swept  Path,  Leg  2,  51  Turn 

Summary  of  Data  and  Contingency  Table,  Maximum  Ratio  Swept  Path,  Leg  2,  51  Turn 

Frequency  Distribution,  Maximum  Ratio  Swept  Path,  Ley  2,  51"  Turn 

Summary  of  Data  and  Contingency  Table,  Average  Ratio  Swept  Path,  Leg  2,  51  Turn 

Frequency  Distribution,  Average  Ratio  Swept  Path,  Leg  2,  51  Turn 

Right  Rudder  Commands  by  Location,  Leg  2,  51  Turn 

Midship  Rudder  Commands  by  Location,  Leg  2,  5l"  Turn 

Left  Rudder  Commands  by  Location,  Leg  2,  51  Turn 

Percent  of  Rudder,  Engine,  and  Thruster  Remaining,  Leg  2,  51  Turn 
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START  TIME  10:0:0  STOP  TIME  10:16:0  TIME  INTERVAL :  0:2  0 


Masters 


START  TIME  10:0.0  STOP  TIME  10:18:0  TIME  INTERVAL:  0:2:0 


Masters,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


START  TIME  10:0:0  STOP  TIME  10:12:0  TIME  INTERVAL:  0:2:0 


Masters,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


HARBOR  KILLVAN 


Masters 


time  interval  0  2  0 


Masters.  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


7226S24  RUNNO.  5,6  HARBOR  KILLVAN 


Figure  C  IO  Track  Plots,  Masters,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


IME  10.0:12  STOP  TIME  10  12:12  TIME  INTERVAL  0  2  0 


1 20 


Figure  C  11.  Track  Plots,  Masters,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


START  TIME  10:0:0  STOP  TIME  10:16:0  TIME  INTERVAL  0  2  0 


Figure  C-1 2.  Track  Plots,  Masters,  Leg  2,  51 '  Turn  and  Leg  3,  129  Turn 


7227  S27  RUN  NO.  8  HARBOR:  KILLVAN 


Figure  C  13.  Track  Plots,  Masters,  Leg  2,  51  Turn  and  Leg  3.  129  Turn 


10  16:12  STOP  TIME  10.0.0  TIME  INTERVAL  0  2  0 


Masters 


START  TIME  10:0:0  STOP  TIME  10:20:0  TIME  INTERVAL  0  2  0 


Figure  C-15.  Track  Plots,  Pilots,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


START  TIME  10:0:0  STOP  TIME  10:16:0  TIME  INTERVAL:  0:2:0 


Figure  C  16.  Track  Plots,  Pilots,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


HARBOR  KILLVAN 


129  Turn 


7216S8  RUN  NO.  8.9  HARBOR:  KILLVAN 


Figure  C-18.  Track  Plots,  Pilots,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


START  TIME  10:1:0  STOP  TIME  10:17:0  TIME  INTERVAL  0:2  0 


Figure  C  19.  Track  Plots,  Pilots,  Leg  2,  ol  Turn  and  Leg  3,  129  Turn 


START  TIME  10:0:0  STOP  TIME  10:14:0  TIME  INTERVAL:  0  2  0 


Figure  C  20.  Track 


RUN  NO  3  HARBOR  KILLVAN 


•eC-21.  Track  Plots,  Pilots,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


IME  10:0:12  STOP  TIME  10:10:12  TIME  INTERVAL  0:2  0 


32  3( 


TIME  INTERVAL 


30  !>()0  ;>9  900  :>9  300  ;)»  ;00 


START  TIME  too  0  STOP  TIME  10:14:0  TIME  INTERVAL  02  0 


Figure  C  24.  Track  Plots,  Pilots,  Leg  2,  51  Turn  and  teg  3.  129  Turn 


START  TIME  10:0:0  STOP  TIME  10:16:0  TIME  INTERVAL  0:2:0 


Plots,  Pilots,  Log  2,  51  Turn  and  Leg  3,  129  Turn 


START  TIME  10  0  12  STOP  TIME  10:16:12  TIME  INTERVAL  0  2  0 


Figure  C  26.  Track  Plots,  Pilots,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


7221  S17  RUN  NO  8  9  HARBOR  KILLVAN 


Figure  C-27,  Track  Plots,  Pilots,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


START  TIME  10:0:0  STOP  TIME  10:16:0  TIME  INTERVAL:  0:2:0 


Figure  C  28.  Track  Plots,  Pilots,  Leg  2,  51  Turn  and  Leg  3,  129  Turn 


TRAINING  OBJECTIVE:  51  Turn 


PERFORMANCE  MEASURE :  CPA  (in  feet)  to  Ship  3 


Masters 

Pilots 

X 

487.35 

504.55 

SD 

90"i> 

Confidence 

237.97 

154.83 

599.92  to  374.78 

577.79  to  431.31 

Interval 

Cutoff  Score:  -431.31.  Subjects  with  scores  -  431 .31  are 
considered  not  to  have  achieved  criterion. 

Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

10 

,  _ 

4 

Wasters 

. 8  ..  ..1 

6 

\J  0.622,  not  significant 


(with  Yates  Correction)  0.1  56,  not  significant 


Figure  C-29.  Summary  of  Data  and  Contingency  Table,  CPA  (in  feet)  to  Ship  3,  Leg  2,  51  Turn 
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TRAINING  OBJECTIVE:  51  Turn 
PERFORMANCE  MEASURE:  Maximum  Swept  Path  (in  feet) 


Masters 

Pilots 

X 

537,78 

548.07 

SD 

69  50 

68.90 

90°.. 

Confidence 

570  65  to  504  91 

580  65  to  515.48 

Interval 

. 

Cutoff  Scoie:  ■  580.65. 

Subjects  with  scores  ■  580.65  ate 

considered  not  to  have  achieved  cntcnon. 

Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

11 

3 

Masters 

7 

7 

\*  2.49,  not  significant 


Figure  C-31 .  Summary  of  Data  and  Contingency  Table,  Maximum  Swept  Path  (in  feet),  Leg  2,  51  Turn 
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rfpjr-.-- 


Figure  C  32. 


TRAINING  OBJECTIVE.  51  Turn 


PERFORMANCE  MEASURE:  Average  Swept  Path  (in  feet) 


Masters 

Pilots 

X 

302.62 

319.92 

SD 

90“ 

Confidence 

38.88 

36.92 

321.01  to  284.23 

337.38  to  302.45 

Intel val 


Cutoff  Score:  337.38.  Sublets  with  scores  >  377.38  an; 

considered  not  to  have  achieved  criterion. 


Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

12 

2 

Masters 

12 

2 

V  (with  Yates  Correction) 

0.292,  not  significant 

Figure  C-33.  Summary  of  Data  and  Contingency  Table,  Average  Swept  Path  (in  feet),  Leg  2,  51  Turn 
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MASTERS.  X  302.62 
PILOTS.  X  -  319.92 


f 
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Figure  C-34.  Frequency  Distribution  Average  Swept  Path,  Leg  2,  51  Turn 


TRAINING  OBJECTIVE:  51  Turn 


PERFORMANCE  MEASURE.  Maximum  Ratio  Swept  Path 


Masters  Pilots 


X 

' 

504  70 

.54806 

so 

1051 

.0813 

90"" 

-  - 

Confidence 

.55442 

.58652  to  .50960 

Intel val 

Cutoff  Score:  '•  0.58652.  Subjects  with  scores  0.58652 
die  consulted  not  to  have  achieved  ciiteiion. 


Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

3 

Masters 

13 

1 

V  (with  Yates  Correction)  0.291 ,  not  significant 


Figure  C  35.  Summary  of  Data  and  Contingency  Table,  Maximum  Ratio  Swept  Path,  Leg  2,  51  Turn 
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h 

I  \ 

I  \  V1ASTTRS,  X  0  50470 

\  ___  __  _ __  PHOTS,  X  0  54806 


Figure  C-36.  Frequency  Distribution,  Maximum  Ratio  Swept  Path,  Leg  2,  51  Turn 
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TRAINING  OBJECTIVE:  51  Turn 


PERFORMANCE  MEASURE:  Average  Ratio  Path 


Masters  Pilots 


X 

0  25369 

.26964 

so 

0  0312 

.0359 

90' . 

—  ■  - - 

Confidence 

0.26845  to  0  23893 

28662  to  0.25265 

Interval 

--  - 

_  __ - -  - 

Cutofl  Score  •  0.28662.  Subjects  with  scores  -  0.28662 
are  considered  not  to  have  achieved  criterion. 


Achieved  Criterion  Not  Achieved  Criterion 


Pilots 

11 

3 

Masters 

12 

2 

\2  =  (with  Yates  Correction)  =  0,  not  significant 


Figure  C  37.  Summary  of  Data  and  Contingency  Table,  Average  Ratio  Swept  Path,  Leg  2,  51  Turn 
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Figure  C-39.  Right  Rudder  Commands  by  Location,  Leg  2,  51  Tu 
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Figure  C  40.  Midship  Rudder  Commands  by  Location,  Leg  2,  51  Turn 


Rudder 

RPM  Ahead 

RPM  Astern 

Thruster 

X 

67.14 

35.14 

18 

8.84 

Masters  S.D. 

4.62 

18.03 

11.08 

n 

14 

14 

1 

2 

X 

69.64 

31.43 

18 

50 

Pilots  S.D 

5.06 

21.95 

- 

- 

n 

14 

14 

2 

1 

t # 

1.365 

0.489 

- 

_ 

df 

26 

26 

- 

- 

'All  comparisons  of  means  for  Masters  and  Pilots  are  not  significant. 


Figure  C  42.  Rudder,  Engine,  Thruster  Percent  Remaining  for  Masters  and  Pilots,  Leg  2,  51  Turn 
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APPENDIX  D 


PERFORMANCE  MEASURES  APPENDICES 
LEG  3  -  129  TURN 

TRAINING  OBJECTIVE:  NEGOTIATING  A  129  TURN  AROUND  SHOAL 
WITH  ONCOMING  TRAFFIC 

LIST  OF  ILLUSTRATIONS 

Number 

D-1  Summary  of  Data  and  Contingency  Table,  Maximum  Swept  Patb  (in  teetl.  Leg  3,  129  Turn 

D  2  Frequency  Distribution  and  Confidence  Interval,  Maximum  Swept  Path  (in  feet).  Leg  3,  129  Turn 

D  3  Summary  of  Data  and  Contingency  Table,  Average  Swept  Path  (in  feet),  Leg  3,  129  Turn 

D-4  Frequency  Distribution,  Average  Swept  Path  (in  feet),  Leg  3,  129  Turn 

D-5  Summary  of  Data  and  Contingency  Table,  Maximum  Ratio  Swept  Path,  Leg  3,  129  Turn 

0  6  Frequency  Distribution  and  Confidence  Interval,  Maximum  Ratio  Swept  Path,  Leg  3,  129  Turn 

D-7  Summary  of  Data  and  Contingency  Table,  Average  Ratio  Swept  Palh,  Leg  3,  129  Turn 

D  8  Frequency  Distribution,  Average  Ratio  Swept  Path,  Leg  3,  129  Turn 

D-9  Percent  of  Rudder,  Engine,  and  Thruster  Remaining,  Ley  3,  129  Turn 
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TRAINING  OBJECTIVE:  129  Turn 


PERFORMANCE  MEASURE:  Maximum  Swept  Path 


X 

SD 

90°u 

Confidence 

Interval 


Masters 
534.01 
52  70 

558  93  to  509.09 


Pilots 

513.98 

43.80 

534.71  to  493.25 


Cutoff  Score:  ■  534.71.  Subjects  with  scores  >  534.71  are 
considered  not  to  have  achieved  criterion. 


Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

13 

1 

Masters 

7 

7 

\2  (with  Yates  Correction) 

4.38,  p-  0.025 

Figure  0-1 .  Summary  of  Data  and  Contingency  Table,  Maximum  Swept  Path  (in  feet).  Leg  3,  129  Turn 


ACHIEVED  CRITERION 


Figure  D  2.  Frequency  Distribution  and  Confidence  Interval,  Maximum  Swept  Path  (in  feet).  Leg  3,  129  Turn 


TRAINING  OBJECTIVE:  129  Turn 


PERFORMANCE  MEASURE:  Average  Swept  Path  (in  feet) 


X 


SO 

90% 

Confidence 

Interval 


Masters  Pilots 


252.81 

252.99 

28.28 

38.88 

266.1910  239.43 

271 .38  to  234  60 

Cutoff  Score:  >  271.38.  Subjects  with  scores  >  271.38  are 
considered  not  to  have  achieved  criterion. 


Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

13 

1 

Masters 

10 

4 

X2  =  (with  Yates  Correction)  -  0.974,  not  significant 


Figure  D-3.  Summary  of  Data  and  Contingency  Table,  Average  Swept  Path  (in  feet).  Leg  3,  129  Turn 


MASTERS.  X  -  252  81 
PILOTS,  X  252  99 


I 
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i r> 

o 

CM 


ro 
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230.5  250  5  270.5  2yu.b  ~ 

Figure  0-4.  Frequency  Distribution,  Average  Swept  Path  (in  feet),  Leg  3,  1?9  Turn 


X 

SD 

90% 

Confidence 
In terval 


Pilots 

Masters 


TRAINING  OBJECTIVE:  129  Turn 
PERFORMANCE  MEASURE:  Maximum  Ratio  Swept  Path 


Masters  Pilots 


0.70326 

0.66443 

0.0589 

0.0462 

0.731 12  to  0.67539 

0.68628  to  0.64258 

Cutoff  Score;  0.68628.  Subjects  with  scores  '  0.68628 

are  considered  not  to  have  achieved  criterion. 

Achieved  Criterion 

Not  Achieved  Criterion 

10 

4 

5 

9 

X2  3  5897,  0.05 

■■  (with  Yates  Correction!  2.29,  p  •-  0.10 


Figure  D-5.  Summary  of  Data  and  Contingency  Table,  Maximum  Ratio  Swept  Path,  Leg  3,  129  Turn 


FREQUENCY 


6250  5  6750  5  7250  5  7  750  5  8250  5 


Figure  D-6.  Frequency  Distribution  and  Confidance  Interval,  Maximum  Ratio  Swept  Path,  Leg  3,  129  Turn 
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TRAINING  OBJECTIVE:  129  Turn 


PERFORMANCE  MEASURE:  Average  Ratio  Swept  Path 


Masters  Pilots 


X 

0.29671 

0.29577 

SD 

0.0266 

0.0140 

90% 

-  -  '  -  - - 

.  -  - 

Confidence 

0.30929  to  0.28413 

0.30239  to  0.78914 

Cutoff  Scoie:  0.302939.  Subjects  with  scoies  -  0.30239 

are  considered  not  to  have  achieved  criterion. 


Achieved  Criterion 

Not  Achieved  Criterion 

Pilots 

10 

4 

Masters 

9 

5 

\J  =  (with  Yates  Correction)  -  0,  not  significant 


Figure  D  7.  Summary  of  Data  and  Contingency  Table,  Average  Ratio  Swept  Path,  Leg  3,  129  Turn 
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2600.5  2800  5  3000  5  3200  5  3400  5 


Figure  D-8.  Frequency  Distribution,  Average  Swept  Path,  Leg  3,  129  Turn 
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Figure  D-9.  Rudder,  Engine,  Thruster  Percent  Remaining  for  Masters  and  Pilots,  Leg  3,  129  Turn 
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Figure  E-1.  Track  Plots,  Masters,  Leg  4,  Propulsion  Failure 
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Figure  E  2.  Track  Plots,  Masters,  Leg  4,  Propulsion  Failure 
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Figure  E  3.  Track  Plots,  Maslers,  Leg  4,  Propulsion  Failure 
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Figure  E  4.  Track  Plots,  Masters,  Leg  4,  Propulsion  Failure 
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Masters,  Leg  4,  Propulsion 
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Masters,  Leg  4,  Propulsion  Failure 
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Masters,  Leg  4,  Propulsion  Failure 
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e  E  12.  Track  Plots,  Masters,  Leg  4,  Propulsion  Failure 
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Figure  E-13.  Track  Plots,  Masters,  Leg  4,  Propulsion  Failure 
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Figure  E  14.  Track  Plots,  Masters,  Leg  4,  Propulsion  Failure 
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Figure  E-16.  Track  Plots,  Pilots  Leg  4,  Propulsion  Failure 
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Figure  E-17.  Track  Plots,  Pilots  Leg  4,  Propulsion  Failure 
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Figure  E-18.  Track  Plots,  Pilots  Leg  4,  Propulsion  Failure 
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Figure  E-21.  Track  Plots,  Pilots  Leg  4,  Propulsion  Failure 
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Figure  E-23.  Track  Plots,  Pilots  Leg  4,  Propulsion 
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Figure  E-24.  Track  Plots,  Pilots  Leg  4,  Propulsion  Failure 


7220  S14  RUN  NO.  6  HARBOR  KILLV AN 


Figure  E-25.  Track  Plots,  Pilots  Leg  4,  Propulsion  Failure 
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Figure  E-27.  Track  Plots,  Pilots  Leg  4,  Propulsion  Failure 
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Figure  E-28.  Track  Plots,  Pilots  Leg  4,  Propulsion  Failure 
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Figure  E-29.  Rudder,  Engine,  Thruster  Percent  Remaining  for  Masters  and  Pilots,  Leg  4,  Propulsion  Failure 


APPENDIX  F 


INSTRUCTIONAL  TECHNIQUES 


INTRODUCTION 

As  the  feasibility  of  training  shiphandling  skills  on  a  simu¬ 
lator  becomes  more  and  more  evident,  certain  advantages 
of  simulator  training  over  on-ship  training  are  immediately 
apparent.  The  high  cost  and  scheduling  problems  of  operat 
ing  a  training  ship,  the  danger  involved,  and  the  limitations 
placed  by  environmental  factors  on  the  types  of  training 
possible  can  be  offset  to  some  degree  by  training  on  a 
simulator,  especially  in  situations  that  are  particularly 
dangerous  or  naturally  infrequent.  In  this  way,  benefits 
can  be  accrued  simply  by  using  the  simulator  as  if  it  were 
an  actual  ship,  and  striving  for  as  much  realism  as  possible 
in  the  training  scenarios.  However,  an  examination  of  the 
literature  on  principles  of  training  suggests  that  the  simu 
lator  provides  an  opportunity  to  employ  what  is  known 
about  the  psychology  of  learning  towards  maximizing  the 
efficiency  and  effectiveness  of  training  programs.  The  new 
trend  in  simulatr  instruction  is  to  present  material,  not 
necessary  to  duplicate  the  real  life  situation,  in  such  a  way 
as  to  ensure  that  it  is  understood  and  remembered,  pro 
moting  the  development  of  the  skills  needed  to  perform 
the  tasks  involved  on  the  job. 

The  literature  available  describing  this  trend  falls  into  four 
broad  categories.  First,  the  dsign  of  the  curriculum  is  of 
critical  importance.  Procedures  for  determining  precisely 
what  is  to  be  taught  are  being  developed,  and  the  order  of 
presentation  is  being  shown  to  have  a  great  effect  on 
learning  efficiency. 

The  second  of  these  broad  areas  is  that  concerning  research 
on  cognitive  styles.  It  is  becoming  recognized  that  people 
have  various  ways  of  acquiring  information  from  the 
environment,  processing  the  information,  and  incorporating 
it  into  their  long  term  memory.  Cognitive  psychologists 
are  classifying  the  different  strategies  used  to  process  and 
store  information  along  various  parameters,  and  are 
developing  ways  of  classifying  people  in  terms  of  their 
predominant  cognitive  strategies.  Attempts,  are  being 
made,  therefore,  to  design  training  programs  which  present 
material  that  is  structured  to  correspond  to  the  individual's 


cognitive  structures.  For  example,  ceitain  people  tend  to 
use  different  hierarchies  of  organization,  or  different 
parameters  of  categorization,  and  matenal  can  be  presented 
with  these  organizational  tendencies  in  mind,  to  make  the 
task  of  learning  and  remembering  that  much  easier  for  each 
individual.  Research  on  specific  cognitive  styles  and  how 
training  can  be  related  to  these  is  examiner!  here. 

LITERATURE  REVIEW 

CURRICULUM  DESIGN 

Perhaps  the  best  way  of  addressing  the  issue  of  curriculum 
design  is  through  employment  of  the  Armed  Forces  Instruc 
tional  Systems  Development  (ISD)  technique.  This  tech 
nique  provides  a  systematic  and  standardized  approach 
toward  the  various  aspects  of  curriculum  design  such  as 
task  analysis,  assessment  of  requirements,  definition  of 
training  objectives,  assessment  of  trainability ,  estimation 
of  benefits,  etc.,  and  thus  represent  perhaps  the  best  way  of 
attacking  the  problem.  Montemerlo  and  Tennyson  (1976) 
Vineberg  and  Joiner  (1978)  provide  a  description  of  the 
development  of  ISD,  an  analysis  of  the  concepts  involved, 
and  a  detailed  description  of  the  methodology  for  designing 
a  training  curriculum. 

Two  other  articles  have  also  been  located  concerning 
factors  of  curriculum  design.  The  first,  Matlick,  Swezey, 
and  Epstein  (1980)  investigates  factor  influencing  the 
design  of  individualized  instructional  piogiams.  Three 
major  areas  are  identified  and  broken  down  into  complex 
subsets.  The  three  areas  are  the  instructional  setting,  the 
focus  (equipment,  technique,  knowledge)  and  time  con¬ 
siderations  (fixed  or  variable  schedules).  Eight  controlling 
influences  on  instructional  piogiams  are  also  described: 
1)  time  available,  2)  instructional  personnel,  3)  facilities, 
4)  instructional  management,  5)  student  population  and 
characteristics,  6)  course  type,  7)  instructive  methods, 
8)  media/materials/devices.  The  paper  assumes  that  training 
standards  will  be  more  or  less  fixed  and  so  four  approaches 
to  training  can  be  used,  with  either  fixed  oi  variable  cur- 
licula  in  various  combinations  with  either  fixed  oi  variable 


training  times.  Some  advantages  anti  disadvantages  of  each 
approach  are  discussed,  and  some  existing  training  pro¬ 
grams  are  described.  (None  of  these  programs,  howevei, 
deal  directly  with  simulated  shiphandling.)  The  major 
idea  here  is  to  strike  a  balance  between  required  standards, 
allotted  time,  and  the  capabilities  of  each  trainee. 

The  other  paper  relating  to  curriculum  design  is  Bergan, 
Cancelli,  and  Towstopiat  (1978).  This  begins  with  the 
premise  that  most  training  tasks  can  be  broken  down  and 
taught  as  hierarchies  of  simpler  skills.  In  order  to  make  sure 
the  hierarchies  are  correctly  designed,  the  authors  say  three 
hypotheses  must  be  tested.  First,  that  the  specific  trainee 
iesponses  called  for  in  training  represent  response  classes 
applicable  under  different  stimulus  conditions;  second 
that  subordinate  skills  in  the  hierarchies  are  indeed  pre¬ 
requisite  to  superordinate  ones;  and  third,  that  prerequisite 
skills  mediate  the  transfer  of  superordinate  ones.  The 
paper  investigates  ways  of  testing  these  hypotheses  and 
describes  in  considerable  detail  the  design  and  analysis  of 
,m  experiment  in  which  these  hypotheses  were  tested.  If, 
is  it  seems  from  the  literature,  it  is  decided  that  training 
->y  components  or  chains  in  a  superior  technique,  the  ideas 
lutlined  in  this  paper  may  prove  useful  in  determining  the 
iroper  relationship  of  the  components  and  chains. 

:OGNITIVE  STYLES 

>ne  article  pertaining  to  cognitive  styles  attempts  to  draw 
omparisons  between  the  semantic  or  organizational 
tructure  of  the  learning  material  and  the  learner's  cognitive 
onstructs.  In  Winn  (1976)  the  author's  premise  is  that  an 
ffective  instructional  system  should  present  information 
i  that  cognitive  structures  resulting  from  instruction 
arrespond  to  the  structure  of  the  content  to  be  learned, 
le  discusses  methods  for  describing  content  structure  and 
ognitive  structure  and  for  comparing  the  two,  then 
resents  and  illutrates  methods  for  studying  changes  in 
ognitive  structure  as  a  result  of  instruction. 

ognitive  structure  is  described  here  as  networks  of  inter 
dated  concepts  forming  a  coherent  conceptual  domain, 
earning  takes  place  when  cognitive  structure  changes 
nd  so  instruction  should  relate  the  nature  of  individual 
oncepts  and  also  the  relations  between  them.  Thus,  an 
nalysis  must  fie  performed  to  determine  such  relations, 
uch  analyses  should  be  concerned  with  observable 
ehaviors  and  also  with  learning  processes.  The  author 
uggests  such  analyses  can  be  carried  out  either  "rationally” 
ir  empirically  and  describes  the  procedures  by  means  of 
i  chart : 


The  author  suggests  that  the  important  thing  is  to  translate 
the  restructuring  of  the  cognitive  construct  into  an  organ¬ 
ized  series  of  actions.  These  actions  are  called  enabling 
objectives  and  are  concerned  with  what  is  to  be  stored  and 
also  what  arrangement  these  things  are  to  be  stored  in  to 
facilitate  retrieval  (i.e.,  what  associations  are  to  be 
emphasized). 

These  restructuring  actions  will  probably  be  different  for 
different  people  and  so  certain  things  about  the  learner 
must  be  known  if  for  instance,  his  ability  to  grasp  concepts 
and  relationships,  aptitude  for  verbal  reasoning,  aptitudes  in 
spatial  abilities  (this  is  suppoed  to  parallel  the  idea  of 
closely  relating  concepts  in  cognitive  space)  tendencies  in 
structuring  information  (field  dependence  test,  visual- 
haptic  test)  and  abilities  to  restructure  information. 

To  assess  progress,  the  author  suggests  deriving  matrices  of 
entry  concepts  and  comparing  them  with  post- instruction 
matric  s.  He  presents  mathematical  models  for  making  this 
comparison  and  for  comparing  the  learner  matrices  with 
the  ideal  matrix  of  the  instructional  design. 

This  article  seems  particularly  important  in  that  it  gives  a 
psychological  foundation  to  the  contention  that  scientific 
curriculum  design  if  of  the  utmost  importance  in  training, 

Another  cognitive  styles  article,  Ausburn  (1979),  postulates 
a  link  between  learning  characteristics  (dictated  by  cogni- 
tive  style)  and  learning  task  requirements.  Where  the  two 
are  compatible,  learning  is  facilitated,  but  where  there  is  a 
discrepancy,  learning  is  hindered.  In  the  latter  case,  the 
instructional  design  should  bridge  the  gaps  between  learning 
style  and  task  requirements.  This  is  done  by  performing  for 
the  learner  tasks  which  he  would  ordinarily  have  to  do 
himself  but  cannot  because  of  limitations  in  his  cognitive 
style  (supplantation).  Thus,  instruction  should  be  designed 
to  interact  both  with  task  requirements  and  cognitive  style. 

The  fust  step  in  supplantational  instruction  design  is  the 
definition  of  the  basic  mental  task  requirements.  Second 
is  the  identification  of  characteristics  that  might  prevent 
the  learner  from  performing  the  task.  Third  is  designing  an 
instructional  tretment  that  can  supplant  the  necessary 
function. 

This  study  investigated  the  learning  of  visual  comparison 
tasks  by  "visuals"  vs.  "haptics"  (the  latter  aie  thought  to 
be  unable  to  retain  visual  images)  and  supplantation  was 
applied.  Two  groups  each  of  visuals  and  haptics  saw  three 
slides  of  machinery  a  close  up  of  a  specific  control  device 


on  a  machine,  a  medium- angle  shot,  and  a  long  range  shot. 
Then  they  had  to  locate  the  control  on  a  drawn  diagram 
of  the  whole  machine.  One  group  each  saw  the  slides  at 
a  time  (linear  condition)  for  3  seconds  each  and  the  other 
groups  saw  the  slides  simultaneously  (multiple  condition) 
for  nine  seconds.  Both  visuals  and  haptics  did  better  in  the 
multiple  condition  compared  to  the  linear  conditions 
(visuals  did  better  than  haptics  in  both  conditions)  but 
haptics  showed  significantly  more  improvement.  The  idea 
is  that  haptics  could  not  store  images  to  perform  the 
linear  comparison  so  the  multiple  presentation  supplanted 
the  process  and  helped  them. 

The  paper  lists  other  cognitive  style  dimensions  that  are 
testable  and  explains  how  these  may  relate  to  training.  The 
dimensions  identified  include:  leveling-sharpening,  distract  - 
ability,  breadth  of  categorization,  scanning,  impulsive- 
reflective,  tolerance  for  unrealistic  experiences,  cognitive 
complexity-simplicity ,  conceptual  style,  » and  grouping 
preference.  Various  aspects  of  a  training  program  should  be 
closely  scrutinized  to  see  whether  any  of  these  factors 
could  influence  the  acquisition  of  certain  skills.  Alternative 
strategies  might  then  be  developed  to  assist  trainiees  whose 
cognitive  styles  might  not  be  conducive  to  learning  portions 
of  the  standard  training  program. 

Another  article  was  located  which  illustrates  the  above 
point.  Johnson  (1978)  describes  a  study  in  which  trainees 
with  differing  degrees  of  vividness  of  mental  imagery  were 
trained  to  run  an  assembly  line  on  simulators  with  different 
levels  of  fidelity.  The  study  showed  a  situation  in  which 
the  degree  of  simulator  fidelity  caused  different  training 
and  transfer  effects  on  different  subjects,  depending  on 
how  they  scored  on  a  scale  of  vividness  of  visual  imagery. 
Thus,  it  is  shown  that  generalizations  about  the  effects  of 
different  treatments  cannot  be  made  without  taking  into 
account  certain  learner  characteristics  which  may  interact 
with  some  instructional  variables. 

INSTRUCTIONAL  TECHNIQUES 

The  literature  that  has  been  placed  in  this  category  also 
points  out  interactional  effects  in  training.  Brown  (1978) 
reports  a  study  which  found  that  students  come  into  the 
learning  situation  with  certain  ideas  as  to  what  styles  of 
teaching  help  them  learn  best.  They  rated  the  actual  teach 
ing  style  they  received  and  it  was  founrl  there  was  a  positive 
correlation  between  the  amount  of  congruence  between 
preferred  and  perceived  teaching  styles  and  high  giades. 
Thus,  it  might  pay  to  make  an  effort  to  teach  a  student  in 
the  manner  which  he  feels  is  most  beneficial.  Also,  the 


interactive  effect  is  shown,  no  one  style  of  teaching  may 
evei  be  found  to  be  best  since  the  learner's  preference 
seems  to  have  an  effect  on  the  relative  effectiveness  of 
different  teaching  strategies. 

Not  only  do  teaching  strategies  interact  with  learnei  van 
ables,  but  they  seem  to  interact  with  one  anothei  as  well 
Briggs,  Naylot,  and  Fuchs  (1975)  demonstrate  just  such  a 
case.  This  experiment  investigated  the  relative  efficacy  of 
whole  task  and  progressive- p;  t  training  strategies  It  was 
founrl  that  as  a  task  becomes  more  complex,  the  progres¬ 
sive-part  technique  (which  is  less  effective  for  Simple  tasks  I 
becomes  better  and  bettei  until  at  a  certain  level  of  com 
plexity  it  surpasses  the  whole-task.  When  task  organization 
level  was  introduced  as  a  variable,  however,  the  trend  was 
reversed;  as  a  task  became  more  highly  organized,  whole 
task  training  became  better  for  more  complex  tasks.  Thus, 
it  can  be  seen  that  careful  task  analyses  must  be  performed, 
especially  concerning  the  organization  and  complexity  of 
a  task,  before  a  training  strategy  is  dediced  upon. 

Much  to  the  same  point  as  the  above  study  is  Bnggs  and 
Johnson  (1977).  This  is  a  lengthy  study  investigating  the 
effects  of  interacting  variables  on  learning.  This  study  used 
a  series  of  written  deciphering  tasks,  ten  to  a  block,  and 
varied  the  spacing  of  the  trial  blocks,  the  frequency  with 
which  subjects  were  provided  with  knowledge  of  training 
standards,  and  the  manner  in  which  these  standards  weie 
presented.  None  of  these  variables  showed  any  significant 
main  effects,  but  various  combinations  of  the  thiee  were 
found  to  produce  significantly  better  performance  than 
other  combinations.  The  authors  suggest,  therefore,  that 
in  implementing  any  training  devices,  the  interaction  of 
new  and  old  training  methods  must  be  studied  first. 

Of  course,  the  most  impoitant  objective  of  training  is  to 
ensure  that  the  material  is  acquired,  retained,  and  ttans 
ferred  to  the  operational  setting.  One  interesting  study, 
Dansereau  (1975),  describes  vanous  principles  of  abstract 
learning  and  applies  them  toward  developing  better  study 
habits.  This  might  well  serve  as  an  introduction  to  any 
training  program  by  outlining  ways  of  enhancing  learner 
strategies  through  techniques  such  as  imagery  linking, 
rehearsal,  etc. 

A  study  which  dnectly  investigated  factors  influencing  the 
transfer  of  training  was  Briggs  and  Johnson  (1976).  This 
study  measured  the  transfer  of  tasks  trained  undei  simple 
conditions  to  a  more  complex  situation.  A  task  involving 
speed  and  accuracy  was  trained,  one  group  being  trained 
for  speed,  the  other  for  accuracy.  In  transfer,  if  the  groups 


195 


1 


were  asked  to  maximize  performance  in  the  other  condi¬ 
tion,  no  significant  decline  in  performance  occurred.  If 
they  were  asked  to  maximize  both  aspects,  however,  both 
suffered  a  decline. 

Another  section  of  the  experiment  involved  training  using 
verbal  coordination  of  team  efforts  but  no  visual  coordina¬ 
tion  ( i . e . ,  each  member  had  his  own  instrument  readout!, 
visual  but  no  verbal  (they  worked  off  the  same  instruments 
but  did  not  discuss  what  they  were  doing),  or  both. 
"Visual"  and  "both"'  were  not  found  to  differ  from  each 
othei ,  but  each  was  significantly  better  than  "verbal"  alone. 

In  addition,  teams  trained  together  showed  no  superiority 
over  teams  which  were  remixed  for  transfer  trials.  It  was 
suggested  that  any  special  effoits  made  to  tiam  teams  in 
the  same  arrangement  in  which  they  will  be  working  will 
mobably  be  wasted. 

One  area  of  particular  interest  in  training  is  the  proper  use 
>f  feedback.  The  utilization  of  feedback  m  training  was 
■xamined  in  a  study  by  Schuster  (1978).  In  this  study, 
drivers  were  trained  in  one  of  four  ways:  no  feedback,  a 
•est  but  no  knowledge  of  results,  a  test  yielding  instant 
knowledge  of  results,  and  two  such  tests  taken  a  week 
part.  The  fourth  group  had  significantly  fewer  accidents 
md  violations  during  the  first  year  of  driving  than  the  first 
,ioup,  although  there  was  no  difference  between  the 
roups  during  the  second  and  thud  years.  Possibly,  the 
roup  trained  with  the  benefit  of  feedback  achieved  a 
rerformance  level  in  one  year  that  it  took  the  other  group 
wo  years  to  achieve. 

\nother  paper  which  is  particularly  valuable  in  applying 
arious  principles  of  behavior  and  learning  to  instructional 
ffectiveness  is  Bailey  and  Hughes  (19781  This  paj>et 
lentifies  and  explains  these  principles  in  teims  of  simulator 
"raining.  Reinforcement  should  be  used  by  identifying 
orrect  behaviors  anil  providing  some  positive  feed  track  for 
■roper  performance.  Conversely,  it  might  also  be  effective 
o  arrange  aversive  feedback  tot  incorrect  perfoimance. 
.haping  is  described  as  systematically  adding  complexity 
o  the  training  task,  starting  at  a  fairly  low  level.  This  way. 
he  trainee  is  able  to  be  reinforced  immediately  anti  can 
ontinue  to  be  reinforced  as  he  piogresses.  Chaining  is  a 
echmque  in  which  the  training  task  is  broken  down  into  a 
■Ties  of  smaller  units.  The  units  are  then  practiced  to 
riterion,  the  last  one  alone  is  practiced  first,  then  the  last 
wo  alone,  the  last  three,  and  so  on  Supposedly,  one 
problem  in  learning  long  sequences  is  that  the  early  seg 
nen.s  are  too  far  lemoved  from  the  reinforcement  of 


performing  the  task  correctly.  The  backward  chaining 
technique  is  designed  to  overcome  this.  Prompting  and 
fading  is  used  by  providing  a  student  explicitly  with  infor¬ 
mation  he  will  eventually  have  to  derive  from  the  environ¬ 
ment.  As  training  progresses,  this  explicit  information  is 
gradually  removed  and  the  student  learns  to  acquire  cues  on 
his  own.  Discrimination  and  simulus  control  is  described  as 
learning  to  perforin  by  responding  to  changes  in  the  stimu 
lus  input,  and  being  able  to  distinguish  the  meanings  of  the 
various  inputs.  Finally,  generalization  refers  to  applying  the 
meanings  one  derives  in  one  situation  to  other  appropriate 
situations. 

Bailey  and  Hughes  also  discuss  the  ide  of  task  analysis  in 
training  techniques.  The  three  maior  areas  here  are  com 
ponent  analysis  (in  which  components  of  a  task  are  first 
learned  separately  and  then  learned  concurrently  I,  chain  or 
sequence  analysis  (which  relates  to  the  backward  chaining 
technique  described  above),  and  dimension  of  difficulty 
analysis  (involving  identifying  the  difficult  aspects  of  a  task 
and  presenting  "watered  down"  versions  of  these  aspects 
early  in  training,  gradually  increasing  them  in  complexity!. 
The  major  thrust  of  the  paper,  then,  is  a  description  of 
ways  to  use  the  simulator  as  a  training  device  rather  than 
merely  as  a  poor  substitute  foi  a  real  life  situation. 

Finally  in  the  area  of  tiaming  techniques  is  in  article  which 
provides  a  veiy  detailed  overview  of  many  aspects  of  the 
question  of  efficient  Paining.  Caro,  Shelnutt,  and  Spears 
(1980)  describe  many  different  factors  influencing  transfer 
of  training.  The  major  thrust  of  the  papei  is  that  behavioi 
should  nol  Ire  considered  a  response  to  a  stimulus  per  se, 
but  rather  as  jn  appropriate  action  taken  in  light  of  the 
meaning  of  the  stimulus,  that  is,  performance  is  guided  by 
cues.  Thus,  trainees  should  be  taught  mediational  processes, 
learning  the  meanings  of  stimuli,  and  not  |ust  the  responses 
to  the  stimuli.  Next,  trainees  should  learn  cue  and  response 
discriminations  noticing  the  difference  in  meaning  of 
various  similar  stimuli,  skills  should  be  taught  in  hierarchies 
so  that  more  complex  skills  can  be  built  on  simpler  ones 
Here,  simulators  can  be  particularly  useful  m  practicing 
components  of  complex  skills  that  cannot  be  isolated  in 
real  life.  Finally,  thr?  trainees  should  be  taught  to  generalize, 
that  is.  to  apply  skills  in  a  situation  different  from  the  one 
m  winch  they  were  learned. 

According  to  this  view,  the  physical  stimuli  in  the  simulator 
need  not  be  identical  to  the  teal  life  situations  as  long  as 
the  psychological  fidelity  is  high,  that  is,  the  same  meanings 
can  lie  extracted  from  stimulus  situations.  The  important 
thing  is  that  students  be  trained  in  mediational  processes. 
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the  extraction  of  meaning  from  situations,  and  thus  the  use 
of  classroom  and  text  instruction  is  valuable.  Also,  the 
trainees  should  be  encouraged  to  "talk  themselves  through" 
learning  situations.  In  this  way,  instructors  can  see  what 
the  students  are  attending  to  and  if  the  propei  meanings 
are  being  extracted. 

The  authors  also  emphasize  the  importance  of  feedback  in 
training,  both  to  maintain  the  student's  motivation  and  to 
inform  him  of  the  appiopriateness  of  his  interpretations 
and  actions.  Intrinsic  feedback  is  the  natural  result  of  the 
performance  itself,  and  the  meanings  usually  have  to  be 
learned.  One  thing  suggested  in  this  paper  is  that  salient 
aspects  of  intrinsic  feedback  can  be  highlighted  in  the 
simulator  to  enhance  learning.  In  addition,  there  is  supple¬ 
mental  feedback  (which  is  not  inherent  in  the  situation) 
which  could  perhaps  be  provided  by  the  instructor  pointing 
out  the  results  of  an  action.  This  would  help  the  trainee 
acquue  cue  meanings  and  discriminatory  ability.  The  timing 
of  feedback  is  important  as  well,  especially  when  the 
relationship  between  rue  and  response  is  not  clear  and 
immediately  recognizable.  In  this  case  feedback  must  be 
virtually  instantaneous  and  the  simulator  should  be  used  to 
provide  this  rapid  feedback  where  a  real  life  situation 
might  not. 

The  concept  of  training  in  this  paper  is  that  of  guidance, 
that  is,  directing  the  actions  of  the  trainee  to  a  desired  goal. 
This  speeds  learning  by  presenting  meanings  of  cues  and 
their  proper  relations  to  responses,  thus  eliminating  the 
waste  of  learning  by  trial  and  error.  Written  and  oral 
instruction  and  demonstrations  all  should  be  incorporated 
into  the  simulator  training  program  to  this  end.  These  ideas 
are  developed  in  the  paper  and  detailed  summaries  are 
provided. 

INSTRUCTOR  CHARACTERISTICS 

The  paper  by  Caro,  Shelnutt  and  Spears  discussed  immedi¬ 
ately  above  also  provides  a  useful  discussion  of  certain 
aspecis  of  instructor  characteristics.  The  major  thiust  of 
this  discussion  is  that  simply  taking  an  expert  pilot  (or 
shiphandler)  and  placing  him  as  an  instructor  is  not  always 
beneficial.  Many  times,  an  experienced  pilot  will  feel  he  is 
being  "stuck’'  m  an  undesirable  situation,  and  this  attitude 
must  interfere  with  his  ability  to  teach.  Further,  the  expert 
is  not  necessarily  familiar  with  the  instructional  techniques 
which  can  be  used  on  a  simulator  and  tends  to  see  the  tasks 
holistically,  using  the  simulator  as  a  substitute  ship,  which 
does  not  utilize  its  training  potential.  The  authors  suggest 


that  instructors  should  be  selectea  for  their  desire  to  be 
instructors,  should  be  trained  in  instructional  techn.ques, 
not  only  in  shiphandling,  and  should  not  have  to  compete 
with  regular  ships  officers  in  terms  of  advancement  and 
recognition.  The  case  for  the  instructional  specialist  is 
strongly  made  in  this  paper. 

Another  paper  was  located  which  also  suggests  the  same 
thing.  Caro  (19761,  in  a  long  and  speculative  paper,  identi¬ 
fies  a  few  instructor  characteristics.  The  author  says  an 
experienced  pilot  does  not  make  a  better  instructor  than 
someone  who  is  specifically  trained  as  a  simulator  instruc¬ 
tor,  although  students  may  have  more  confidence  in  the 
experienced  pilot.  The  author  offers  several  suggestions 
which  are  speculative,  but  noteworthy:  good  instructors 
teach  what  is  needed  for  the  assignment,  not  everything 
they  know;  good  instructors  do  things  to  simulate  opera¬ 
tional  situations:  good  instructors  let  trainees  go  further 
before  hitting  the  freeze  button,  and  good  instructors 
concentrate  on  trainees'  needs  rather  than  on  just  getting 
through  the  syllabus. 

Certain  aspects  of  instruction  behavior  that  might  influence 
the  ability  of  students  to  learn  have  also  been  investigated. 
One  paper,  Land  (1979),  identified  several  behavioral 
variables  which  made  a  teacher  present  at '•  on  "clear"  or 
"unclear."  The  author  video-taped  a  "clear"  lecture  and 
an  "unclear"  one  and  measured  the  performance  of 
students  taught  by  each.  Students  taught  by  the  cleat  tape 
performed  better  on  a  test  immediately  following  the 
lecture.  It  might  be  valuable,  therefore,  for  instiuctois  to 
be  trained  in  clarity  of  presentation,  since  this  can  be 
quantified,  and  does  appear  to  affect  student  learning. 

Another  article  investigating  instructor  behavior  was  found 
to  be  narticularly  applicable.  Krahenbuhl  and  Reirl  (1980) 
assert  that  stress  is  a  main  cause  of  failure  in  training 
programs.  Research  is  cited  indicating  that  high  levels  of 
arousal  bias  a  students'  search  process  toward  readily  avail¬ 
able  responses,  which  is  not  appropriate  in  a  learning 
situation.  The  experimenters  categorized  various  instructor 
behaviors  into  commands,  instructional  cues,  questions, 
acceptance,  general  praise,  specific  praise,  general  scold, 
specific  scold,  correction,  positive  modeling,  and  negative 
modeling.  These  categories  were  class' ted  as  negative  ot 
positive  and  certain  latios  were  established  to  characterize 
instructors  as  either  positive  or  negative.  Physical  indices  of 
student  stress  levels  were  measurer)  and  it  was  found  that 
students  of  negative  instructors  experienced  significantly 
more  stress  than  did  students  of  positive  instructors:  thus 
the  former  suffered  in  training.  This  study  is  significant  m 
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identifying  specific  behaviors  which  cause  stress  in  students, 
thus  enabling  instructors  to  be  trained  to  avoid  them. 

The  above  study,  generally  speaking,  seems  to  indicate  that 
the  person-to-person  interaction  of  instructor  and  pupil 
can  affect  learning.  A  report  by  Coehls  (1979)  is  an  in 
foimal  and  rather  prosey  discussion  of  the  interpersonal 
relationship  between  instructor  and  pupil.  This  might  be 
interesting  for  prospective  instructors  to  read  before 
entenng  the  training  situation. 

Finally,  a  description  of  how  the  instructor  should  be 
involved  in  all  aspects  of  training  is  provided  in  Charles 
(1977)  (NTIS  No.  AD  A047919).  This  paper  breaks  down 
the  role  of  the  instructor  into  discrete  segments  and 
analyzes  the  procedures  foi  achieving  these  segments.  The 
majoi  segments  ate:  Preparation,  Briefing,  Initialization, 
Training,  Evaluation,  Debriefing,  Data  Management,  and 
Syllabus  Development.  The^i:  segments  are  further  broken 
down  into  35  sub-functions  which  are  explained  in  the 
lepoit.  In  this  view,  the  instructor  interacts  with  the 
training  curriculum  so  that  the  curriculum  design  is  a 
dynamic  and  flexible  procedure  which  can  be  tailored  to 
the  needs  of  the  student  and  the  capabilities  of  the 
instructor. 


SUMMARY 

Reading  the  current  research  literature  on  training  makes  it 
fairly  evident  that  training  is  developing  into  a  science  and 
the  simulator  can  occupy  a  key  role  in  its  development. 
It  is  being  recognized  that  training  can  be  carried  out  much 
more  rapidly  and  less  expensively  if  it  is  approached  sys 
tematically,  and  ways  are  being  developed  to  accomplish 
this.  In  order  to  know  how  best  to  teach  it  must  be  known 
exactly  what  to  teach,  what  tasks  are  involved,  and  what 
basic  skills  are  needed  to  perform  these  tasks.  The  impor¬ 
tance  of  this  kind  of  task  analysis  is  becoming  evident  and 
piocedural  guidelines  have  been  developed  to  standardize 
and  facilitate  the  process.  Once  the  tasks  have  been 
analyzed,  various  methods  of  presenting  the  material  can 


be  used,  employing  what  is  known  about  human  learning 
and  behavior,  to  help  the  student  understand  what  informa 
tion  he  needs  to  make  his  decisions,  how  to  use  the  infor¬ 
mation,  what  his  responses  ought  to  be,  and  how  best  to 
carry  out  those  responses.  The  role  of  the  instructor  is 
under  investigation  as  well,  and  behaviors  that  can  facilitate 
or  interfere  with  the  learning  piocess  are  being  identified 
as  specifically  as  possible.  The  simulator  can  and  should  be 
used  to  piesent  ceitain  information  and  in  certain  arrange¬ 
ments  which  facilitate  learning  and  which  cannot  be  pre¬ 
sented  in  the  natuial  environment.  It  is  the  new  job  of  the 
instructor  to  understand  the  science  of  training,  in  addition 
to  the  science  of  shiphandling. 

One  view  of  the  process  involved  in  shiphandling  reduces 
this  piocess  to  a  scientifically  manageable  level  and  suggests 
a  direction  foi  future  research.  Shiphandling,  and  indeed 
most  similar  activities,  can  be  seen  as  a  series  of  decisions 
which  must  be  made.  In  order  to  make  these  decisions 
correctly,  the  shiphandler  must  extract  certain  information 
from  the  environment  on  which  to  base  them.  This  infor¬ 
mation  is  available  either  directly  from  the  environment 
oi  indirectly  via  the  ship's  instrumentation  and  comes  to 
the  shiphandlei  through  vanous  perceptual  states  and 
events.  Thus,  it  is  vital  that  the  shiphandlei  trainee  learn 
where  to  locate  the  specific  information  he  needs  in  a  pai 
ticular  instance,  and  how  to  correctly  interpret  the  percep¬ 
tual  events  that  contain  the  information.  What  is  needed, 
then,  is  research  to  determine  exactly  what  information  is 
used  by  the  expert  shiphandlei  in  the  performance  of  his 
tasks.  If  this  information  and  its  location  in  the  environ¬ 
ment  can  he  identified,  the  attention  of  the  trainee  can 
then  be  directed  toward  it,  thus  speeding  the  training 
process.  In  addition,  the  meanings  of  various  states  and 
changes  in  the  environment  can  be  taught  directly,  hope¬ 
fully  lessening  the  number  of  things  the  trainee  must  learn 
for  himself  thiough  experience.  The  simulator  can  be  used 
in  this  way  to  highlight  and  provide  meaning  to  the  infor¬ 
mation- beating  aspects  of  the  environment.  This  extia 
information  can  be  phased  out  gradually  as  training  pro¬ 
gresses,  thus  leaving  the  trainee  better  able  to  deal  with  the 
problems  he  will  face  in  the  teal-life  situation. 
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